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SUMMARY 


Decision  analysis  concepts  and  methcdology  have  been  demon- 
strated to  have  high  potential  for  assisting  defense  decision- 
makers. However,  such  assistance  for  defense  executives  can  now 
be  provided  by  only  a few  dozen  professionals  who  have  both  the 
required  technical  competence  and  communication  skills. 

Various  computerized  aids,  such  as  the  SRI  computer  programs 
for  decision  tree  evaluation,  facilitate  the  analysis  of  a decision 
problem;  however,  the  existing  software  Is  useful  only  In  the 
hands  of  a well-trained  analyst  or  an  exceptional  executive.  Fur- 
thermore, these  programs  only  deal  with  a portion  of  the  decision 
analysis  process. 

We  are  engaged  In  the  first  year  of  a multi-year  program 
to  design  a broad  system  of  Integrated  computer  aids  for  decision- 
making that  will  foster  the  widespread  application  of  declsloii 
analysis.  This  system  encompasses  all  of  the  model  building 
assessment,  and  analytical  steps  In  the  decision  analysis  proceed. 
In  particular,  the  system  augments  the  thought  process  of  the 
user  to  describe  the  problem  In  convenient  terms  and  to  construct 
e useful  decision  model.  In  addition,  the  system  permits  assessing 
the  Information  and  preferences  of  the  decision-maker  or  his  dele- 
gates. Finally,  the  system  determines  the  best  course  of  action 
within  the  scope  of  the  formulation  and,  by  providing  aids  such 
as  sensitivity  analyses,  gives  the  decision-maker  Insight  Into  why 
that  course  of  action  was  selected. 


1 


Rather  than  begin  with  the  Immediate  development  of  various 
computer  aids,  we  have  reviewed  the  decision  process  to  determine 
the  communicative,  creative,  and  analytic  functions  that  must  be 
performed.  Next,  we  are  representing  these  functions  in  a piecise 
morphology  that  constitutes  a logical 'framework  for  characterizing 
and  analyzing  decision  problems.  The  morphology  describes  the 
alternatives,  probabilities,  model  structure,  values,  time  pre- 
ference, and  risk  preference  in  the  problem  as  well  as  the  pro- 
cedures necessary  to  elicit  this  characterization  and  to  evaluate 
the  resulting  decision  model. 

Designing  computer  aids  requires  striking  a compromise  between 
the  needs  of  the  user  and  the  difficulty  of  Implementing  the  pro- 
cedure on  a computer:  Too  often,  the  compromise  is  at  the  expense 

of  the  user.  We  believe  we  will  ultimately  achieve  a better  design 
by  ignoring  the  constraints  of  existing  computer  systems  while 
developing  the  morphology.  The  objectives  of  the  five-year  program 
are  therefore: 

The  definition  of  a precise  morphology  for  characteri- 
zing and  analyzing  decision  problems. 

The  development  of  a system  of  Integrated  computer  aids 
for  decision  analysis  based  on  the  morphology. 

The  Implementation  of  the  system  and  its  refinement 
to  the  point  where  it  is  both  easy  to  use  and  sufficiently 
powerful  to  handle  large,  complex  decision  problems. 
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The  cocnnunicatlon  of  the  system's  advantages  to  potential  users. 


This  report  summarizes  our  progress  to  date  on  morphology  definition. 
It  consists  of  three  sections.  Section  1 describes  our  research  program 
to  develop  a system  of  computerized  aids  for  decision  analysis.  Specific 
research  objectives  are  defined  and  an  eight  element,  five  year  program 
plan  for  achieving  these  objectives  is  outlined.  The  first  section  con- 
cludes with  a discussion  of  the  types  and  characteristics  of  decision  prob- 
lems that  are  encountered  in  practice.  Section  2 of  the  report  deals  with 
the  fundamental  components  of  a decision  morphology,  the  analytical  and 
communicative  processes  that  are  needed  to  analyze  the  broad  range  of  de- 
cision problems.  Both  recent  results  and  areas  where  further  research 
is  essential  to  the  construction  and  analysis  of  decision  models  are  ad- 
dressed here.  Section  3 presents  an  Illustrative  implementation  of  the 
morphology.  The  graphical  algebraic  technique  described  is  the  precursor 
to  an  automated  system  for  decision  making  and  is  envisioned  as  one  of 
its  fundamental  components. 

Our  research  has  exposed  many  issues  material  to  decision-making, 
to  decision  analysis,  and  to  the  design  of  systems  foi  using  decision 
analysis  in  decision-making.  The  primary  goal  of  the  research  during 
the  next  six  months  is  to  complete  the  specification  of  the  morphology 
to  the  point  where  it  can  provide  a secure  foundation  for  the  development 
and  implementation  of  a system  of  Integrated  computer  decision  aids. 
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SECTION  I 


RESEARCH  PROGRAM 
1.1  Research  Oblectlves 

The  advantage  to  decision  makers  of  having  guidance  in  the 
analysis  of  decision  problems  has  been  amply  demonstrated  by  cases 
where  the  time  and  resources  for  analysis  were  readily  svailsble. 
However,  the  need  for  guidance  in  rapidly  developing  decision  sit- 
uations and  the  shortage  of  trained  analytical  personnel  mean  that 
few  decisions  can  receive  the  amount  of  analysis  they  deserve. 

The  major  hope  in  realizing  the  benefits  of  insightful  analysis 
lies  in  using  the  computer  to  assist  the  analytical  process.  The 
assistance  would  be  helpful  at  all  levels,  from  the  original  charac- 
terization of  the  problem  by  the  decision  maker  to  the  sophisticated 
manipulation  of  a decision  model  by  the  analyst.  If  such  decision 
aids  were  available,  decision  makers  could  use  some  of  them  alone 
to  achieve  the  benefits  of  preliminary  analysis  in  problems  that 
now  receive  only  intuitive  treatment.  Analysts  in  turn  could 
provide  analysis  in  depth  in  situations  where  they  now  have  the 
time  or  resources  for  only  initial  consideration  of  important  Issues. 

The  availability  of  effective  aids  could  have  an  Important 
effect  not  only  on  individual  decisions,  but  on  the  style  of  decision- 
making. In  our  present  world  without  easily  accessible  decision 
aids,  decision  makers  can  make  decisions  intuitively  without  criticism, 
but  they  may  be  considerably,  and  unconsciously,  limited  in  the 
size  of  the  projects  they  will  undertake  or  in  their  boldness  of 
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execution,  perhaps  because  they  lack  systematic  mears  to  convince 
themselves  or  their  colleagues  of  the  wisdom  of  their  decision. 

The  attractiveness  of  a system  that  would  simultaneously 
aid  In  making  Individual  decisions  and  Improve  the  style  of  decision 
making  Is  so  great  that  one  would  be  tempted  to  start  writing 
computer  programs  to  Implement  It  as  soon  as  possible.  However, 
experience  shows  that  a rush  to  programming  often  yields  computer 
aids  chat  reflect  existing  programming  languages  more  than  the 
needs  of  the  problem.  We  feel  It  Is  Important  to  emphasize  the 
needs  of  the  customer  rather  than  the  capabilities  of  the  computer, 
for  the  kind  of  system  we  are  proposing  will  develop  over  many 
years  Into  a complete  and  powerful  workshop  of  decision  aids. 

Early  compromises  will  become  Increasingly  difficult  to  accommodate 
as  time  passes. 

Consequently  we  have  started  on  this  long-term  quest  of  a decision- 
aiding  system  by  developing  a logical  framework  for  characteri- 
zing and  analyzing  decision  problems  which  we  call  a morphology. 

Problems  posed  within  the  morphology  may  even  be  beyond  the  capa- 
bilities of  present  computers,  but  this  will  only  restrict  the 
present  Implementation  of  the  methodology.  As  computers  Increase 
In  capability,  the  type  of  problem  treatable  by  the  morphology 
will  grow  apace  In  complexity  and  size. 

Developing  the  morphology  Is  thus  the  first  phase  of  the  re- 
search program.  When  It  Is  developed  It  will  be  Implemented,  to 
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the  extent  feasible  and  eccmomlcal,  with  present  computeis.  This 
implementation  will  in  turn  require  design,  execution,  and  testing 
of  appropriate  computer  programs.  Thus  though  our  ultimate  goal 
is  to  provide  future  decision  makers  and  analysts  with  unusually 
powerful  <^8slstance,  we  begin  by  developing  a morphology,  a formal 
description  of  the  decision  procesp. 

We  view  the  development  of  a system  of  integrated  aids  for 
decision  analysis  as  a multi-year  program  guided  by  the  following 
objectives: 

The  definition  of  a precise  morphology  for  characterizing 
and  analyzing  decision  problems. 

Tlte  development  of  a system  of  integrated  computer  aids  for 
decision  analysis  based  on  the  morphology. 

The  liup.imentatlon  of  the  system  and  its  refinement  to  the 
point  where  it  is  both  easy  to  use  and  sufficiently  powerful 
to  handle  large,  complex  decision  problems. 

® The  communication  of  the  system's  advantages  to  potential 
users. 

1. 2 Research  Plan 

To  accomplish  these  objectives  we  have  formulated  a five- 
year  program  plan  consisting  of  eight  primary  elements.  We  are 
currently  in  the  first  year  of  this  program.  The  program  elements 
are : 

Morphology  Development 
Pilot  Experimentation 


Language  Dealgn 
System  Design  and  Integration 
Prototype  Implementation 
Test  and  Evaluation 
Design  for  I'rlllzatlon 
Connnunlcatlon  with  Potential  Users 
The  time  phasing  of  these  elements  appears  in  Figure  1.1; 
they  have  the  following  brief  descriptions: 

Morphology  Development.  In  this  element  we  review  the  decision 
process  to  determine  snd  describe  the  communicative,  creative, 
and  analytic  functions  that  must  be  performed.  We  next  define 
a logical  framework  for  the  system  of  computer  aids  by  develop- 
ing a precise  morphology  for  characterizing  and  analyzing 
decision  problems.  The  morphology  must  describe  the  alter- 
natives, probabilities,  model  structure,  values,  time  pre- 
ference, and  risk  preference  In  the  problem  as  wall>«a^^flne 
the  procedures  necessary  to  elicit  this  characterization  and  to 
evaluate  the  resulting  decision  model.  The  morphology  must 
also  treat  Interactions  between  each  of  these  components 
to  show  how  modifications  to  one  part  of  the  process  can  affect 
other  parts. 

Pilot  Experimentation,  The  process  of  developing  the  morpho- 
logy will  raise  many  Issues  In  analysis  and  elicitation  that  can 
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be  resolved  most  easily  by  experimentation  on  a limited  scale. 
For  example,  ease  In  describing  a problem  using  the  morpho- 
logy can  be  assessed  only  In  a simulated  problem-solving 
environment.  Such  experimentation  Is  especially  Important 
In  cbcsaing  means  of  graphical  communication  for  the  user. 
Language  Deeign.  Once  the  morphology  is  specified.  It  will  be 
possible  to  design  a <_omputer-Lree  meta-language  for  Imple- 
mentation. This  language  will  then  be  used  to  conitruct 
the  decision-aiding  system  and  the  actual  language  for  user- 
machine  communication. 

System  Deeign  and  Integration,  The  existence  of  the  morphology 
will  permit  designing  a consistent  system  configuration  and 
operating  philosophy.  The  design  will  become  increasingly 
specific  In  later  years  through  interpretation  of  the  meta- 
language on  the  prototype  computer  system. 

Prototype  Implementation. In  year  3,  the  prototype  system 
of  decision  aids  will  begin  to  take  form  on  the  prototype 
computer  system.  The  basic  system  will  be  ready  for  testing 
In  year  4.  Additional  features  and  revisions  will  continue 
throughout  the  program. 

Test  and  hvaluation.  The  implemental  system  will  require 
testing  and  evaluation  In  both  Its  basic  and  advanced  forma. 
Initial  tests  will  be  performed  on  selected  system  features; 


later  tests  will  probe  the  Integrating  ability  of  the  system. 
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Deeign  for  Utilization.  Regaidless  of  its  Inharcat  merit, 
the  system  of  computer  elds  will  achieve  Its  potential  only 
If  the  process  of  Introducing  Its  use  In  the  decision  process 
Is  carefully  planned.  The  system  tjst  exceed  the  expectations 
created  for  It  If  user  response  Is  to  be  enthusiastic.  Design 
for  utilization  will  require  Identifying  high  priority  users 
and  user  groups,  planning  a schedule  of  Introduction  con- 
sistent with  facility  and  educational  requirements,  and  deter- 
mining to  what  extent  the.  prototype  system  need  be  modified 
to  meet  diverse  user  needs. 

Cormuniaation  with  Potential  Ueere.  To  create  an  effective 
design  for  utilization  will  require  a multi-year  effort  to 
Identify  users,  their  needs,  and  their  views  on  the  emergent 
system  of  computer  decision  aids.  Joint  exploration  with 
potential  users  should  permit  selecting  a representative  group 
of  users  for  participation  In  the  test  and  evaluation  program. 
The  five  year  program  will  result  Ip  a highly  effective  system 
of  computerized  decision  aids  tested  by  users  and  responsive  to  their 
needs.  We  anticipate  that  this  system  will  be  but  the  beginning 
of  a sequence  of  progressively  more  sophisticated  decision-aiding 
systems  that  will  be  employed  by  Increasingly  diverse  and  extensive 
user  groups. 
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1.3  Characterizing  Decision  Problems  and  Processes 


The  precening  discussion  has  summarized  the  objectives  of  this 
research  program  and  the  steps  required  to  achieve  the  objectives. 
The  following  paragraphs  deal  with  the  many  types  of  decision 
problems  that  are  encountered  In  practice.  An  Inmiedlate  objec- 
tive of  our  current  research  Is  to  design  a decision  morphology 
that  is  sufficiently  general  that  It  will  be  relevant  to  any  of  the 
daelslom  problems  described  below. 

Types  of  Decision  ProbZerna.  There  are  many  ways  to  characterize 
decision  problems,  but  some  characteristics  are  more  funda- 
mental chan  others.  During  our  research  we  have  found  the 
following  attributes  to  be  the  most  useful  In  describing 
a decision  environment.  Decision  problems  can  be  character- 
ized by  the  degree  to  which  each  attribute  applies. 

(1)  Time  Dependence  (static  vs  dynamic  environments): 

Decision  environments  that  change  over  time  are  Inherently 
more  difficult  to  analyze  than  those  that  are  static.  A 
situation  can  be  dynamic  because  parameters  are  changing 
(e.g.  construction  costs  are  Increasing)  — or  because  the 
structure  of  the  problem  Is  altered  (e.g.  a new  construction 
process  becomes  available) . 

(2)  Sequential  decision  structure  (sequential  vs  non-sequentlal 
decisions).  Time  can  also  play,  an  Important  role  In  a decision 
problem  If  a series  of  decisions  are  made  sequentially.  Each 
decision  In  the  sequence  may  have  a different  structure  and 
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and  be  based  on  a different  state  of  information.  However, 
there  are  often  repetative  elements  of  sequential  problems 
that  can  be  used  to  aimp:.lfy  the  analysis  of  such  problems. 

(3)  Time  availability  (planning  vs  crisis  environments) : 

The  time  available  for  analyzing  and  making  a decision  often 
governs  the  way  we  approach  the  problem.  The  distinction 
between  planning  and  crisis  declslona  can  be  complicated  in 
situations  when  the  time  available  for  a decision  is  uncertain. 

(A)  Scale  of  resources  (major  vs  minor  decisions) : 

There  are  two  resource  levels  that  must  be  considered  in  a 
decision  problem:  the  value  of  outcomes  that  might  be  affected 

by  the  decision,  and  the  level  of  resources  allocated  by  the 
decision.  Decisions  can  become  critical  when  they  involve 
large  amounts  of  resources,  but  little  time  is  available  for 
the  decision. 

(5)  Scope  of  the  decision  (specific  vs  policy  decisions); 

Some  decisions  deal  with  specific  resource  allocations.  Other 
decisions  are  designed  to  set  policy  and  give  guidance  to  those 
who  must  make  specific  decisions. 

(6)  Uncertainty  (probabilistic  vs  deterministic  environments): 
Decision  makers  almost  never  know  the  exact  consequences  of 
choosing  an  alternative  at  the  time  they  must  make  a decision. 
However,  the  parameters  and  structure  of  a decision  problem 
can  be  known  with  varying  degrees  of  expertise. 
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(7)  Complexity  (simple  vs  complex  decisions) : 

Decisions  environments  can  range  from  those  with  a few  basic 
elements  to  those  comprised  of  large  numbers  of  interrelated 
components.  To  a certain  extent,  the  complexity  of  a decision 
depends  on  how  the  decision  maker  approaches  it;  one  person 
may  taI-->  r.n  e_ementary  view  of  a decision  situation  while  another 
person  could  consider  the  same  decision  in  minute  detail. 

(8)  Continu:»ty  (continuous  vs  discrete  environments) : 

In  some  decisions,  there  are  only  a few  discrete  alternatives 
available.  In  other  situations  the  decision  maker  can  set 
the  level  of  some  parameter  to  any  value  in  a specified  range. 
Similarly,  various  elements  of  the  problem  can  take  on  only 
certain  values  or  vary  over  a range. 

Decision  Pyocessee.  In  addition  to  characterizing  decision 
problems,  we  can  describe  the  procev'^s  by  which  a decision  is 
reached.  This  process  depends  primarily  on  the  number  of  people 
involved  in  the  decision  and  their  level  of  experience  or 
training  in  analyzing  decisions. 

(1)  Number  of  people  involved  in  decision  (individual  vs  multi- 
person decision  making) : 

A decision  can  be  made  by  a single  individual,  or  several  people 
can  cooperate  or  compete  to  produce  the  decision.  Similarly 
information  and  value  assessments  can  be  made  by  individuals 
or  groups.  The  problem  can  also  be  defined  or  analyzed  by 
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one  or  nore  people.  In  each  case,  the  number  of  people  invol- 
ved will  affect  the  way  In  which  the  situation  Is  analyzed  and  a 
decision  reached. 

(2)  Level  of  training  and  experience  (analytical  vs  Intuitive 
decision  making) : 

The  process  by  which  a decision  Is  reached  depends  on  the  back- 
grounds of  the  Individuals  involved  In  the  decision.  One  person 
might  use  highly  sophisticated  analysis  techniques  to  reach 
a decision,  while  another  might  rely  on  his  Intuition. 

Similarly  those  who  assess  parameters  of  the  decision  environ- 
ment may  or  may  not  base  their  estimates  on  careful  training  and 
encoding  procedures. 

The  following  section  deals  with  the  analytical  emd  communicative 
processes  that  are  made  to  deal  with  the  range  of  decision  problems 
described  above. 
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SECTION  2 


COMPONENTS  OF  A DECISION  MORPHOLOGY 


A study  of  the  form  and  structure  of  declf Ion  analysis  is 
complicated  by  the  fact  that  there  Is  no  single  procedure  that 
decision  makers  and  decision  analysts  follow  when  dealing  with  a 
complicated  decision  problem.  Rather,  there  are  a number  of  con- 
ceptual tools  that  are  available  to  an  analyst,  and,  within  cer- 
tain limits,  the  tools  can  be  used  In  any  order. 

The  conceptual  tools  of  decision  analysis  are  often  used 
Iteratively  and  repeatedly  to  build  an  explicit  representation  of 
a decision  environment.  To  be  effective,  a system  of  automated 
decision  aids  should  capture  this  pattern.  The  decision  maker  or 
analyst  should  be  able  to  move  back  and  forth  among  the  various  In- 
dividual aids  selecting  the  ones  that  are  most  useful  at  each  stage 
of  the  analysis.  For  the  least  experienced  users,  the  order  In 
which  the  decision  aids  are  employed  may  be  determined  automatically 
on  the  basis  of  the  user's  problem  structure.  However,  more  so- 
phisticated users  will  undoubtedly  want  a kit  from  which  they  can 
select  or  construct  the  most  appropriate  tool  at  each  stage  of  the 
analysis.  The  purpose  of  this  section  is  to  describe  conceptual  tools 
that  will  form  the  basis  of  an  Integrated  set  of  automated  decision  aids. 

A complete  workshop  has  a wide  variety  of  tools:  some  are 
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simple  and  can  be  used  by  the  novice,  some  are  highly  specialized, 
and  some  can  be  used  to  build  other  tools.  The  same  should  be 
true  of  a comprehensive  set  of  automated  decision  aids,  Ho^'ever, 
in  the  following  discussion  of  the  conceptual  tools  that  constitute 
the  decision  morphology,  we  will  be  primarily  Interested  in  the 
more  powerful  and  general  aspects  of  decision  analysis  that  would 
be  of  use  to  an  experienced  analyst.  We  must  have  a clear  under- 
standing of  these  fundamental  building  blocks  before  we  can  develop 
concepts  and  decision  aids  that  would  be  of  use  to  a decision  maker 
with  little  training  in  decision  analysis. 

Some  of  the  following  topics  have  received  more  attention 
than  others,  because  we  have  concentrated  our  efforts  in  the  areas 
that  are  most  critical  to  the  development  of  a unified  morphology 
and  the  areas  that  are  relatively  unexplored.  We  will  now  m^n  ion 
only  briefly  the  areas  we  have  not  investigated.  During  the 
remainder  of  our  research,  we  Intend  to  examine  these  areas  to 
balance  our  understanding. 

Inferential  Notation 

When  studying  problems  of  decision  making  it  is  desirable  to 
make  as  explicit  as  possible  the  conditions  underlying  any  proba- 
bilistic statement.  Our  discussion  of  the  components  of  a decision 
morphology  will  occasionally  make  use  of  a notation,  termed  infer- 
ential notation,  that  has  been  developed  for  this  purpose.  The 
following  paragraphs  are  a brief  description  of  this  notation. 

The  basic  concept  of  inferential  notation  is  that  every  proba- 
bility assignment  is  conditional  on  some  state  of  information. 
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whxch  we  may  describe  generically  by  n , If  A Is  some  event, 
we  define  {A|n}  to  be  thf  probability  of  A given  the  state 
of  information  n.  If  x is  a random  variable,  then  we  define 
{x|n}  to  be  the  density  function  of  x given  n.  The  distinction 
between  events  and  random  variables  is  usually  apparent  from  con- 
text. By  extension,  if  y is  another  random  variable  then 
(x.y|n}  is  the  Joint  density  function  of  x and  y,  {x|y,n}  is 
the  conditional  density  function  of  x given  y,  etc. 

A particularly  Important  state  of  information  is  the  prior 
experience  brought  to  the  problem,  which  we  denote  by  Any 
probability  assignment  conditional  only  on  ^ is  called  a prior 
assignment.  Thus,  {a\0  Is  the  prior  probability  of  the  event 
A;  {x|^}  is  the  prior  probability  density  of.  the  random  variable 
X.  For  simpllcty  we  sometimes  shorten  {Aj^}  to  {A}  when  the 
state  of  Information  is  obvious  from  context. 

The  notation  extends  to  moments.  We  define  <x|n>  to  be  the 

expectation  of  the  random  variable  x given  the  state  of  Information 
n,  computed  from 


<x|n>  “ /jj  X (xln) 

where  is  a general  summation  operator.  Then  <x"|n>  is  the 

nth  moment  of  x.  We  denote  the  variance  of  x by 

V.|n>  - <x  ln>  - <x|n>^  = <(x-<x|n>)*h>. 
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2.1  MODELING 


2.1.1  Algebraic  and  Graphical  UtnguageB  for  ConstructlnR  and 
Deacrlblng  Models 

To  conceptualize  and  construct  a model  that  adequately  des- 
cribes a decision  situation,  an  analyst  often  attempts  to  visualize 
the  decision  process  In  both  graphical  and  algebraic  terms.  For 
example,  the  output  of  a power  generating  plant  can  be  described 
as  an  algebraic  function  of  the  amount  of  fuel  consumed  by  the 
plant,  the  energy  content  of  the  fuel,  and  the  plant  efficiency. 
Alternatively,  the  role  of  the  plant  In  a complex  power  generating 
and  distribution  system  might  be  described  graphically  by  a flow 
chart  that  Indicates  the  various  material  and  power  flows  throughout 
the  system.  Similarly,  the  probabilistic  dependence  of  Interna- 
tional events  on  U.S.  foreign  policy  decisions  can  be  described 
algebraically  by  a set  of  conditional  probability  distributions, 
or  graphically  by  a decision  tree  with  event  probabilities  dependent 
upon  the  alternatives  chosen  by  U.S.  policy  makers. 

Some  types  of  problems  are  easier  to  conceptualize  In  alge- 
braic terms;  other  problems.  In  graphical  terms.  The  choice  of  a 
particular  modeling  language  depends  on  both  the  nature  of  the 
problem  and  the  background  of  the  analyst.  Some  analysts  prefer 
to  visualize  complex  systems  In  terms  of  flow  charts,  tree  struc- 
tures, block  dlagrtims,  or  graphical  functions  In  several  dimensions. 
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Other  analysts  might  deal  with  the  same  problem  in  terms  of 
systems  of  equations,  alpha-numerl.:  llstt  of  data,  or  algebraic 
computer  programs  (FORTRAN,  /JLGOL,  LISP,  etc.) 

There  Is  no  single  language  that  is  •’best"  for  describing 
a particular  decision  situation.  In  fact,  there  is  value  in 
looking  at  several  different  descriptions  of  the  same  problem. 
Different  modeling  languages  tend  to  illuminate  different  as- 
pects of  the  problem  being  studied.  An  analyst  may  often 
switch  back  and  forth  between  algebraic  and  graphical  represen- 
tations of  a decision  environment  and  may  also  use  several  differ- 
ent languages  of  each  type  in  analyzing  a single  decision  problem. 

For  example,  a de:lslon  tree  is  often  used  to  describe  and 
analyze  complex  decision  situations.  However,  decision  trees 
can  become  so  large  and  complex  that  they  cannot  be  visualized, 
let  alone  drawn,  in  their  entirety.  As  a result,  analysts  have 
developed  a number  of  compact  graphical  notations  for  suBoarlzing 
the  essential  features  of  a large  decision  tree.  In  this  case, 
the  analyst  may  find  it  valuable  to  translate  among  several  dif- 
ferent graphical  and  algebraic  representations  of  the  j Mem. 

Entities  and  Operators 

All  modeling  languages  have  in  common  certain  fundamental 
building  blocks.  These  elements  can  be  combined  to  describe 
many  complex  decisions.  The  basic  elements  of  all  models  are 
entitles  and  operators.  Entities  describe  the  state  of  the  envieon- 
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nient,  and  operators  describe  how  the  stete  of  the  envlronnent  1b  modified. 


(. 


1. 


Modeling  entitles  can  be  numbers,  arrays,  functions  over  time, 
strings  of  alpha-numeric  data,  algebraic  variables,  logical 
variables,  decisions,  complex  variables,  etc.  Operators  trans- 
form one  entity  Into  another. 

For  example.  Entity  could  be  the  demand  for  a particular 
quantity  at  a certain  time.  Entity  E^  could  be  the  equilibrium  price 
of  that  quantity  In  a competitive  market.  Operator  Oj^  could  trans- 
form the  demand  for  this  product  into  the  equilibrium  market  price. 

An  economist  might  view  this  transformation  In  terms  of  the  demand 
curve  shown  In  Figure  2.1a,  but  In  more  general  terms,  we  can  view 
this  process  as  that  of  an  operator  (the  demand  curve)  transforming 
entity  (demand)  Into  entity  E2  (price)  as  shown  In  Figure  2.1b. 

In  general,  operators  can  tratsform  combinations  of  entitles 
and  operators  Into  other  combinations  of  entitles  and  operators. 

For  example,  operator  0^^  could  take  values  of  one  entity  called 
X and  transform  them  Into  another  entity  called  Y , using  the  equa- 
tion Y ■ 3X  + 2.  A second  operator,  ©2,  could  be  one  that  solves 
algebraic  equations  for  X . W^»>n  ©2  Is  applied  to  0^^,  e third 

operator  Is  produced,  0^.  0^  takes  the  entity  called  Y and 

transforms  It  Into  the  entity  called  X using  the  equation 
X ■ (Y  - 2)/3.  These  three  operators  are  shown  In  Figure  2.2. 
Hievarchioat  Definition  of  Operators 

Not  only  can  operators  transform  entitles  and  other  operators, 
but  an  operator  may  consist  of  a set  of  entitles  and  operators.  For 
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example,  a simple  model  of  a coal-burning  power  plant  might  consist 
of  a single  operator  that  transforms  the  fuel  consumption  of  the 
plant  and  the  energy  content  of  the  fuel  into  the  power  produced 
by  the  plant.  The  operator  that  carries  out  this  transformation 
is  shown  in  Figure  2.3a,  However,  in  a more  detailed  model  of 
the  power  plant's  performance,  this  operator  may  consist  of  sev- 
eral components  that  describe  the  parts  of  the  power  plant.  Figure 
2.3b  shows  an  expanded  model  in  which  the  operator  describing  plant's 
power  production  has  been  decomposed  into  other  operators  and  en- 
titles that  collectively  transform  the  fuel  consumption  and  energy 
content  of  the  fuel  into  the  power  produced  by  the  plant. 

It  la  often  valuable  to  expand  portions  of  the  model  by  des- 
cribing the  process  in  greater  detail.  However,  large  models  are 
often  hard  to  understand  without  combining  model  elements  into 
global  units  that  show  the  analyst  an  overview.  By  allowing  opera- 
tors to  comprise  other  operators  and  entitles,  an  analyst  can 
aggregate  and  disaggregate  the  model  and  thus  obtain  perspective 
on  the  problem. 


Specifying  Linkacjes  Between  Entities  and  OpexKitore 

The  links  between  operators  and  entitles  are  often  described 
implicitly  by  the  definition  of  the  operators.  For  example. 
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FIGURE  2.3a  SIMPLE  MODEL 


FIGURE  2.3  MODELS  OF  A COAL  BURNING  POWER  PLANT 


an  operator  that  transforms  demand  Into  price  should  be  linked  to 
an  Input  entity  representing  demand  and  to  an  output  entity  rep- 
rest  "Ing  price.  However,  the  linkages  between  operators  and 

I 

entitles  need  not  be  specified  by  the  operator  definition.  It  Is  j 

possible  to  find  general  types  of  operators  and  entitles,  and  later 

specify  the  linkages  that  connect  then.  While  a separate  sped—  ] 

1 

flcatlon  of  the  linkages  between  entitles  and  operators  may  be  j 

i 

rather  cumbersome  for  simple  problems,  It  can  be  a powerful  tech- 
nique for  generating  large  models. 

A typical  large  decision  model  might  contain  thousands  of 

1 

entitles  and  operators.  If  an  anlayst  were  required  to  specify  ■ 

each  of  the  entitles,  operators,  and  linkages,  the  process  of  ■ 

modeling  would  be  long  and  tedious.  Furthermore,  the  analyst  j 

could  easily  lose  sight  of  the  global  structure  of  the  problem.  ^ 

To  overcome  these  difficulties,  analysts  have  developed  several  j 

procedures  for  specifying  large  models  by  specifying  classes  or 

hierarchies  of  entitles  and  operators.  For  example,  combinations  ] 

of  entitles  and  operators  are  often  grouped  together  to  form  a j 

composite  operator,  as  shown  In  Figure  2.3.  | 

However,  the  definition  of  operators  consisting  of  other  oper-  i 

atcrs  and  entities  is  only  one  of  the  ways  an  analyst  can  define  ! 

classes  or  hierarchies  of  operators.  In  general,  classes  of  opera- 
tors can  be  defined  through  the  use  of  "operator  rules."  An  operator 
rule  defines  a partition  of  all  of  the  operators  and  entitles  that 


exist  in  a particular  decision  model.  For  example,  an  operator 
rule  might  state  that  all  of  the  elementr  of  a particular  model 
are  associated  with  one  of  several  types  of  materials  used  In  the 
production  of  energy  (coal,  oil,  nuclear  power,  etc.).  A second 
operator  rule  might  state  that  all  entitles  exist  In  one  of  sev- 
eral regions  (the  Persian  Gulf  area.  North  Africa,  the  United 
States,  Western  Europe,  etc.).  The  Intersection  of  these  two 
operator  rules  defines  a large  number  of  entitles,  such  as  Per- 
sian Gulf  oil.  Western  European  coal,  etc. 

The  operator  rules  may  contain  a statement  that  some  of  the 

elements  defined  by  the  Intersection  of  the  two  rules  cannot  ex- 

ist (for  example,  Persian  Gulf  coal).  A third  operator  rule  might 
state,  in  general  terms,  the  relationship  between  various  classes 
of  entitles,  for  example  the  relationship  might  state  the  amount 

of  gasoline  that  can  be  produced  from  a unit  of  crude  oil.  A 

combination  of  these  rules  can  be  used  to  define  a very  large  net- 
work of  entitles  and  operators  without  making  It  necessary  for 
the  analyst  to  describe  every  element  and  operator  In  the  model. 

We  can  view  the  generation  of  a large  model  through  the  use 
of  operator  rules  as  a transformation  from  one  modeling  language  to 
another.  The  operator  rules  are  themselves  described  by  general 
entitles  and  operators  that  are  combined  with  those  of  other  oper- 
ator rules  to  form  the  complete  model.  A set  of  operator  rules  can. 
In  Itself,  be  a complete  model  of  the  decision  situation,  thus, 
even  at  a very  basic  level,  there  Is  no  unique  model  for  modeling 
language. 
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Directional  Nature  of  Operators 

By  deflnltiorii  operators  have  a direction;  they  transform 
Inputs  Into  Outputs,  but  not  vice  versa.  Thus,  we  can  view  opera- 
tors as  a mapping  from  one  entity  space  to  another.  One  Implica- 
tion of  this  deflnltloh  Is  that  an  equation  Is  not  an  operator 
unless  we  specify  which  variables  In  the  equation  are  Inputs  and 
which  are  outputs.  For  example,  the  equation  X - X + 1 has  no 
solution,  but  If  we  define  the  left  side  of  the  equation  to  be  the 
output  and  the  right  side  of  the  equation  to  be  the  Input,  this 
equation  defines  a perfectly  valid  operator.  This  operator  has 
entity  X as  both  an  Input  and  an  output;  Its  function  Is  to  add 
one  to  the  value  of  X . If  we  wish  to  solve  algebraic  equations 
using  our  definition  of  entitles  and  operators.  It  Is  necessary 
to  specify  the  equation  In  tev-ns  of  an  operator  with  an  Input  and 
an  output.  We  can  then  define  a second  operator  that  solves  the 
equation  and  produces  a third  operator  with  different  Inputs  and 
outputs  (see  Figure  2.3). 

By  defining  operators  to  be  directional,  we  can  avoid  a num- 
ber of  theoretical  difficulties.  If  we  were  to  view  operators  as 
simply  being  relationships  among  entitles,  without  the  concepts 
of  Input  and  output,  we  could  find  ourselves  In  the  position  of 
specifying  models  that  are  either  Insoluble  or  possess  many  solu- 
tions. Although  we  can  define  a relationship  In  which  the  entity 
Y can  be  determined  from  the  value  of  entity  X , the  mapping  from 
X to  Y need  not  be  'bne-to-one"or  'bnto'I  "One-to-one"  means 
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that  there  is  a unique  value  of  Y for  every  different  value  of 
X . "Onto"  means  that  there  is  some  value  of  X corresponding 
to  every  possible  value  of  Y . 

If  the  mapping  from  X to  Y is  not  one-to-one  and  onto,  then 
certain  values  of  Y will  have  no  corresponding  values  of  X . 

In  this  case,  it  is  very  difficult  to  interpret  the  relationship 
between  X and  Y as  one  in  which  X can  be  determined  from  Y . 
In  other  words,  the  relationship  between  X and  Y contains  im- 
plicit direction:  X is  the  input  and  Y is  the  output. 

It  is  possible  to  reverse  the  mappings  that  are  not  one-to- 
one  and  onto  by  defining  certain  special  conventions,  but  we  be- 
lieve it  would  be  better  to  Include  these  conventions  in  the  defi- 
nition of  a directional  operator.  For  example,  equation 

V . 

is  unambiguous  when  we  are  trying  to  determine  Y given  X . 
However,  when  we  are  given  Y and  attempt  to  solve  for  X , we 
find  that  there  can  be  more  than  one  solution  or  no  solutions  at 
all,  depending  on  the  value  of  Y . In  order  to  overcome  this 
difficulty,  we  might  establish  the  convention  that  X will  always 
be  the  positive  square  root  of  Y , if  Y is  greater  than  or  equal 
to  zero,  and  X will  be  zero  if  Y is  less  than  zero.  By  making 
operators  directional,  we  require  that  these  conventions  be  an  ex- 
plicit part  of  the  operator  defintion. 

If  we  were  to  consider  operators  to  be  non-directional  rela- 
tionships among  entitles,  then  we  could  no  longer  consider  the 


the  operator  to  be  a mapping  from  the  space  of  one  entity  to  the 
space  of  another.  Instead,  operators  would  define  the  sub-space 
of  the  space  spanned  by  all  of  the  entitles  associated  with  the 
operator.  Thus,  for  example,  the  relationship  Y ■ 3X  +2  de- 
fines a straight  line  In  the  two-dimensional  Euclidean  space  spanned 
by  31  and  Y . This  simple  example  might  lead  us  to  assume  that 
each  operator  or  relationship  defines  an  (n-1)  dimensional  sub-space 
of  the  n-dlmenslonal  space  spanned  by  the  entitles.  However,  this 

Is  not  the  case.  The  equation  X - X does  not  reduce  the  dlmen- 

2 2 

slonallty  In  the  space,  while  the  equation  X + Y "0  reduces 
a two-dimensional  space  to  one  with  zero  dimensions.  To  avoid 
these  conceptual  difficulties,  we  will  limit  our  definition  of 
operators  to  meaning  a directional  mapping  from  a set  of  Inputs 
to  a set  of  outputs. 

Computational  Graphs 

When  operators  and  entitles  are  linked  togfether,  either  Indi- 
vidually or  through  the  use  of  operator  rules,  the  result  Is  a 
computational  graph  that  specifies  the  structure  of  the  model. 

These  graphs  can  be  used  to  specify  any  of  the  models  used  in  de- 
cision analysis:  decision  trees,  Markov  processes,  financial  models, 

material  flows  over  time,  fault  trees,  etc.  In  fact,  given  the  very 
basic  nature  of  operators  and  entitles,  it  Is  difficult  to  conceive 
of  a model  that  cannot  be  put  into  the  form  of  a computational 
graph.  This  Is  not  to  say  that  computational  graphs  are  the  most 
efficient  way  to  model  every  decision  problem,  but  rather  that 
they  are  sufficiently  Important  that  they  should  be  incorporated 
Into  any  general  modeling  language. 
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Computational  graphs  can  be  classified  according  to  the  de- 
gree they  are  interconnected.  One  of  the  simplest  forms  of  com- 
putational graphs  Ic  a tree.  All  the  linkages  of  a tree  are 
directed  either  from  or  to  a unique  starting  point  or  origin. 

There  must  be  only  one  path  that  connects  any  pair  of  nodes,  and 
If  one  of  those  nodes  Is  the  origin,  all  of  the  operators  along 
that  path  must  be  oriented  In  the  same  direction.  Figure  2.4a 
shows  an  example  of  the  tree. 

A slightly  more  general  version  of  a computational  graph  Is 
a lattice.  A lattice  Is  a tree  In  which  the  branches  are  allowed 
to  coalesce  or  connect  together.  In  a lattice  there  can  be 
multiple  paths  between  each  pair  of  nodes,  but  If  one  of  the 
nodes  Is  the  origin,  then  all  of  the  operators  along  each  of  the 
paths  must  be  oriented  In  the  same  direction — either  toward  the 
origin  or  away  from  the  origin.  Figure  2.4b  shows  an  example  of 
a lattice. 

Trees  and  lattices  have  the  advantage  of  not  containing 
loops.  A graph  contains  a loop  If  two  nodes  In  the  graph  are 
connected  by  two  or  more  paths,  such  that  all  of  the  operators 
along  one  path  lead  from  the  first  node  to  the  second  and  all  of 
the  operators  along  another  path  lead  In  the  other  direction.  An 
example  of  a grpph  containing  a loop  is  shown  In  Figure  2.4c. 

The  existence  of  loops  makes  It  much  more  difficult  to  process 
the  computational  graph,  but  It  also  makes  It  possible  to  simplify 
the  structure  of  the  graph.  Conventions  must  be  established  for 
dealing  with  loops  In  computational  graphs,  but  once  this  Is  done. 


it  may  be  possible  to  represent  very  large  (in  fact,  infinite) 
decision  problems  In  compact  form.  For  example,  a Markov  process 
can  be  represented  as  an  Infinitely  large  decision  tree.  Although 
a decision  tree  may  be  easier  to  process  than  a Markov  diagram,  the 
unbounded  nature  of  the  decision  tree  makes  It  Impossible  to  solve 
completely.  On  the  other  hand,  Markov  processes  can  be  represented 
and  solved  using  relatively  simple  and  compact  computational  graphs 
containing  loops. 

These  basic  components  of  a modeling  language  are  sufficiently 
general  to  allow  the  construction  of  many  different  types  of  models — 
both  probabilistic  and  deterministic.  An  example  of  how  such  a lan- 
guage might  be  Implemented  is  presented  In  Section  3 of  this  report. 


2.1.2  Management  of  Model  Growth 


Historically,  modeling  has  been  the  art  of  decision  analysis, 
while  decision  theory  has  been  the  science.  Modeling  will  always 
require  Judgment  and  creativity  from  the  analyst,  but  there  are 
several  areas  In  which  computerized  decision  aids  can  be  used  to 
help  the  creative  process. 

The  type  of  modeling  used  In  decision  analysis  Is  '‘top-down". 
For  example.  In  government  decisions  the  objective  Is  to  maximize 
social  profit;  however,  directly  estimating  social  profit  for  each 
alternative  In  a decision  problem  Is  equivalent  to  choosing  the 
best  alternative  by  Intuition.  To  effectively  use  experts  we  di- 
vide social  profit  Into  benefits  and  costs.  Each  of  these  cate- 
gories Is  further  subdivided  until  we  reach  the  level  wi.ere  ex- 
perts are  available  to  estimate  the  Inputs  to  the  model.  The 
stopping  point  Is  a decision  not  an  outcome.  For  example.  If  one 
of  the  costs  Is  for  crude  oil  In  1980,  we  can  estimate  It  directly, 
or  we  can  build  a world  energy  model  to  predict  the  future  price 
of  crude  oil. 

Figure  2.5  shows  how  top-down  modeling  Is  Integrated  Into  the 
decision  analysis  cycle.  At  the  start  of  the  .>roJect  Intuition 
and  direct  assessment  are  used  to  predict  social  profit  and  many 
alternatives  are  discarded  without  formal  analysis.  As  the  deter- 
ministic phase  progresses  Increasingly  complex  models  are  built. 
Near  the  end  of  the  deterministic  phase  the  model  complexity  peaks. 
Then  deterministic  sensitivities  are  used  to  eliminate  unimportant 
variables.  Finally  the  model  Is  frozen  for  use  during  the  proba” 
blllstlc  phase. 
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A tsore  realistic  view  of  decision  analysis  Is  the  rising  wave 
of  Figure  2.6  rather  than  the  single  hump  of  Figure  2.5.  The 
analyst  uses  sensitivities  both  to  Identify  areas  where  additional 
modeling  Is  required  and  to  eliminate  unnecessary  complexity. 

The  result  Is  that  %dille  the  complexity  continually  expands  and 

contracts,  the  average  over  time  gradually  rises,  capturing  only  | 

the  most  Important  aspects  of  the  decision  problem. 

Eliminating  unnecessary  complexity  Is  one  distinguishing 
characteristic  of  decision  analysis.  Without  our  willingness 
to  discard  data,  mjdel  complexity  would  rise  exponentially  as 
shown  by  the  dotted  line  In  Figure  2.6. 

The  distinction  between  model  expansion  and  contraction  Is  ^ 

Important  because  the  modeling  effort  requires  different  computer 
aids  during  each  phase.  During  the  construction  or  expansion  of 
a model,  an  analyst  will  use  general  modeling  languages,  such  as 
those  discussed  In  the  preceding  section.  To  eliminate  unnecessary 
complexity,  and  limit  the  size  of  the  model,  an  analyst  needs  con- 
ceptual tools  for  evaluating  the  relative  worth  of  the  various 
components  of  the  model.  These  tools— like  sensitivity  analysis, 
and  procedures  for  determlrilng  the  value  of  various  types  of  In- 
formation and  flexibility — will  be  discussed  In  the  following 
sections. 

2 . 2 THEORETICAL  PROPERTIES  OF  PROBABILISTC  MODELS 

Probabilistic  models  are  fundamental  to  the  analysis  of  de- 
cisions under  uncertainty.  However,  the  theoretical  development 
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FIGURE  2.6  GENERAL  DESCRIPTION  OF  THE  MODELING  PROCESS  IN  DECISION  ANALYSIS 


of  procedures  for  dealing  with  probabilistic  models  has  not  kept 
pace  with  the  extensive  literature  on  deterministic  models  (linear 
systems  theory,  optimal  control,  linear  programming,  optimization 
techniques,  etc.)*  The  purpose  of  this  section  is  to  explore  some 
of  the  theoretical  properties  of  probabilistic  models  that  will 
form  the  basis  for  conceptual  modeling  tools  in  automated  decision 
aids. 

There  are  two  ways  to  look  at  probabilistic  models.  One  is 
CO  view  them  as  deterministic  models  that  contain  some  uncertain 
parameters,  in  which  case  the  major  modeling  effort  is  devoted  to 
building  the  deterministic  model.  In  this  case,  most  of  the 
relationships  among  the  parameters  of  the  model  are  in  the  form 
of  equations;  uncertainty  is  introduced  into  the  model  by  specifying 
the  probability  distributions  for  various  model  parameters. 

The  second  approach  is  to  use  a probabilistic  model  as  a 
direct  description  of  an  uncertain  environment.  In  this  case, 
the  relationships  among  the  parameters  of  the  model  are  often 
probabilistic,  meaning  that  even  if  we  knew  all  of  the  inputs  to 
the  model  with  certainty  the  output  of  the  model  must  still  be 
described  by  a probability  distribution. 

It  is  possible  to  view  the  first  approach  to  probabilistic 
modeling  as  a special  case  of  the  second,  in  which  all  of  the  prob- 
abilistic relationships  among  the  parameters  of  the  model  are  ap- 
proximated by  deterministic  equations.  In  many  modeling  efforts 
both  approaches  are  used;  the  resulting  decision  model*  contain 
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both  deterministic  and  probabilistic  parameters,  and  both  deter- 
ministic and  probabilistic  relationships  among  the  parameters. 

The  following  subsections  explore  the  probabilistic  rela- 
tlonsnlps  that  can  exist  among  model  and  the  Im- 

plications of  the  various  uncertainties  In  the  model  for  the  value 
of  Information  and  flexibility.  The  last  subsection  contains  a 
brief  discussion  of  two  additional  theoretical  properties  of  Im- 
portance to  probabilistic  modeling:  Joint  time-risk  preference, 

and  models  of  competitive  decisions. 

2.2.1  Proballstlc  Dependence 

To  simplify  the  tasks  of  assessing  and  processing  uncertain 
Information  It  Is  often  necessary  to  assume  that  random  variables 
are  Independent,  v'lth  this  assumption,  It  Is  possible  to  assess 
the  probability  distribution  for  each  random  variable  separately, 
and  deal  with  relatively  simple  marginal  probability  distributions 
rather  than  complicated  conditional  distributions.  Most  large 
decision  analysis  projects  contain  within  them  some  Implicit  or 
explicit  assumptions  about  the  independent a of  various  random 
variables. 

In  order  to  describe  Independencies,  we  need  to  have  a clear 
understanding  of  the  types  of  Independence  that  are  possible.  Two 
random  variables  are  either  dependent  or  Independent.  However,  as 
we  shall  see,  there  are  twenty-two  different  combinations  of  depen- 
dence and  Independence  that  can  exist  among  three  random  variables. 


When  there  are  more  than  three  random  variables,  there  are  many 

different  combinations  of  dependence  and  Independence  that  exist 
among  them. 

This  section  describes  the  twenty-two  combinations  of  depen- 
dence and  Independence  that  can  exist  among  thret  random  variables 
and  gives  an  example  of  each  combination.  A similar  discussion 
can  be  found  in  a book  entitled.  "Rational  Descriptions,  Decisions 
and  Deslgr.s."  by  Myron  Trlbus  [12].  However.  Trtlbus  discusses  only 
twelve  of  the  twenty-two  possible  combinations  of  dependence  and 
Independence  that  can  exist  among  three  random  variables. 
dependence  Equation  for  Tao  Random  VaHablea 

When  we  assert  that  two  random  variables  are  independent, 
we  are  assuming  that  their  joint  probability  distribution  is 
equal  to  the  product  of  the  two  marginal  probability  distributions. 

In  other  words,  if  we  say  that  random  variables  A and  B are  in- 
dependent, then  we  are  claiming  that  the  following  equation  is  true. 

{AB}  - {A}  {B} 

Alternatively,  If  we  say  that  A and  B are  dependent,  then  we 
are  claiming  that  the  equation  above  is  not  true.  To  avoid  writing 
an  equation  for  each  Independence  assertion,  we  will  denote  the  as- 
sumption of  Independence  between  random  variables  A and  B as 
follows;  I(A,B).  If  A and  B are  dependent,  then  we  write 

I(A,B).  If  there  are  only  two  random  variables,  then  we  must  have 
either  I(A,B)  or  I(A,B). 
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Independence  Equations  for  Three  Rccndom  Variables 

If  we  have  three  random  varlables-^A  , B , and  C — then  there  are 
ten  possible  Independence  equations.  For  example,  we  can  assume 
that  the  three  random  variables  are  mutually  Independent,  which 
means  that  their  joint  probability  distribution  Is  equal  to  the 
product  of  the  three  marginal  distributions.  Mutual  Independence 
Is  equivalent  to  the  following  equation. 

{ABC}  - {A}  {b}  {c}  . 

If  the  three  random  variables  are  not  mutually  Independent,  then 
this  equation  Is  not  true.  In  our  notation  mutual  Independence 
Is  written  1(A,B,C).  If  the  three  random  variables  are  not  mutu- 
ally Independent,  we  write  I(A,B,C).  The  lack  of  mutual  Indepen- 
dence does  not  mean  that  the  three  random  variables  are  mutually 
dependent,  since  other  types  of  Independence  are  possible.  Mutual 
dependence  means  that  there  are  no  Independencies  among  any  of  the 
random  variables. 

Another  type  of  Independence  that  can  be  asserted  among  the 
three  random  variables  Is  that  two  of  the  three  random  variables 
are  Independent  without  regard  to  the  third.  When  we  have  three 
random  variables — A , B , and  C — we  can  assert  1(A,B)  or  equivalently 

{AB}  - (A)  (b)  . 

In  our  notation,  this  Independence  equation  Is  denoted  1(A,BC). 

This  equation  means  that  learning  the  value  of  A will  not  change 
the  Joint  probability  distribution  for  B and  C . Alternatively, 
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it  means  that  learning  B and  C will  not  change  the  probability 
distribution  for  A . We  could  also  assert  that  B is  Independent 
of  A and  C , or  that  C is  independent  of  A and  B . 

When  we  learn  the  value  of  one  of  i:he  three  random  variables, 
it  changes  our  state  of  information  and  therefore  can  change  our 
assumptions  about  Independence  for  the  remaining  random  variables. 
This  allows  us  to  make  «i  different  kind  of  Independence  assumption. 
For  example,  we  can  assume  that  when  we  know  C , A and  b are 
independent.  The  actuation  for  this  Independence  assumption  is 

{ABjc}  - {a|c}  {b|c} 

When  {c}  f 0,  the  following  equation  la  equivalent  to  the  one  above. 

{AT.C}  . 


This  Independence  assumption  is  denoted  I(A,b|C).  As  before,  we 
can  find  some  other  Independence  assumptions  by  permuting  the 
random  variables.  Thus,  -'.an  assume  that  B and  C are  Indenen- 
dent  when  we  Vj\ow  A , c ;an  assume  that  A and  C are  inde- 
pendent when  we  know  B . 

In  this  discussion  it  will  be  assumed  that  Independence  can 
only  be  asserted  among  quantities  that  are  each  based  on  the  same 
state  of  informs  cion.  Independence  among  quantities  that  are  based 
on  different  states  of  Information  is  difficult  to  conceive  since 
the  different  states  of  Information  may  themselves  affect  the  val- 
idity of  the  independence  assumption.  For  example,  can  we  assert 


This  is  not  a restrictive  condition  since  {AB|c},  {a[c},  and 
{b|c}  are  not  defined  when  {c}  ■ 0. 
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independence  between  A by  itself,  and  B given  C ? The  answer 
to  this  question  is  no,  since  the  independence  equation  corres- 
ponding to  this  statement  is  not  well  defined.  We  are  trying  to 
assert  independence  between  {a}  and  {b|c},  and  by  analogy  with 
the  other  independence  equations  we  should  be  able  to  equate  the 
product  of  these  two  quantities  to  some  other  quantity.  However, 
it  is  not  clear  whether  the  product  should  equal  {AB},  {AB|c},  or 
something  else. 

In  summary,  there  are  ten  possible  Independence  equations  or 
as8u<<iptlons  that  can  be  made  for  three  random  variables.  These 
independence  equations  are  listed  below. 

(1)  I(A,B,C)*^  {ABC}  - (A)  (B)  (c) 

(2)  1(A,B)  -«■  (AB)  - (A)  (B} 

(3)  I(A,C)  (AC)  - (A)  {C} 

(A)  I(B,C)  (BC)  - (B)  (C) 

(5)  I(A,BC)  ■»-*■  (ABC)  - (A)  (BC) 

(6)  I(B,AC)  (ABC)  - {B}  (AC) 

(7)  I(C,AB)  (ABC)  - (C)  (AB) 

(8)  I(A,B|C)  {AB|C}  - {A|C}  {b|c} 

(9)  I(A,C|B)  ^ {AC|b>  - {a|b}  {c|b} 

(10)  i(B,c|A)  {bc|a>  - {b|a}  {c|a} 

Relationships  AmoriQ  Independence  Eouatione 

Since  each  of  these  Independence  equations  can  be  either  true 
or  not  true,  there  would  be  or  1,024  possible  combinations  of 
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dependence  and  Independence  among  three  random  variables  If  it 
were  not  for  the  fact  that  some  of  the  Independence  equations 
imply  others.  We  can  use  the  relationships  among  the  ten  Inde- 
pendence equations  to  eliminate  most  of  the  1,024  possible  com- 
binations, leaving  twenty-two  possible  combinations  of  Indepen- 
dence assertions  that  can  exist  among  three  random  variables. 

The  first  relationship  among  the  Independence  equations  Is 
that  mutual  Independence  Implies  all  of  the  other  types  of  Inde- 
pendence. 

I(A,B,C)  - I(A,B),1(A,C),I4B,C),I(A,BC),I(B,AC),I(C,AB), 

i(a.b|c),i(a,c|b),i(b,c|a) 

To  prove  this  relationship  we  start  with  the  equatlonj for  mutual 
Independence  {ABC}  - (A)  {B>  (c).  If  we  Integrate  both  sides  of  this 
equation  over  sll  possible  values  of  C , we  have  (AB)  - (a)  (B). 

This  proves  that  A and  B are  Independent  without  regard  to  C , 
or  I(A,B).  Similarly,  by  Integrating  over  all  possible  values 
B and  A.,  we  find  that  (AC)  - (A)  (C)  and  (BC)  - (B)  (C).  These 
two  equations  are  equivalent  to  I(A,C)  and  I(B,C'.  If  we  substitute 
these  equations  Into  the  equation  for  mutual  Independence,  we 
have  (ABC)  - xA>  {BC}  - {B}  {AC}  - {C}  {AB},  or  I(A,BC) , I(B,AC), 
and  I(C,AB)  By  using  these  results  we  show  that 

{AB|C}  - 


^Is  Is  not  a restrictive  condition  since  {ABIc},  {AIc},  and 
{B|C}  are  not  defined  when  {C}  - 0.  I i I /. 
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This  Is  equivalent  to  1(A|B|c),  In  exactly  the  same  way  we  can 
prove  1(A,c1b)  and  I(B,c|a)  when  B + 0 and  A + 0.  Thus,  mutual 
Independence  implies  all  other  types  of  Independence. 

The  other  relationships  among  the  Independence  equations  are 
listed  below.  The  proofs  for  these  relationships  are  similar  to 
the  one  for  mutual  Independence,  and  they  are  outlined  briefly. 


1. 


2. 


3. 


A. 


I(A,B,C)  I(A,B),  I(A,C),  I(B,C),  I(A,BC),  I(B,AC),  I(C,AB), 

i(a,b|c),  i(a,c|b),  i(b,c|a) 

KA.BC)  I(A,B),  I(A,C) 

Proof:  I(A,BC)  - {ABC}  - (A)  (BC)  - /{ABC}  - /{A}{BC} 

c c 


{AB}  * {A}(B}  - I(A,B) 

i(A,Bc)  -*•  i(a,b|c),  i(a,c|b) 

Proof:  I(A,BC)  - I(A,B),  I(A,C)  {AB}  - {A}{B},  {AC}  - {A}{C} 

. ^AB}  _ {AC} 

“rBT'-Tcr 

KA.BC)  - (ABC)  - (AHBC)  - ***^j^^*  - **‘^j*j‘^*  ■* 


i(a,b|c),  i(a,c|b) 

I(A,BC),  I(B,C)  I(A,B,C) 

Proof:  I(B,C)  -*•  {BC}  - {B}{C} 

I(A,BC)  - {ABC}  - {A}{BC}  - {A}{B}{C}  -*•  I(A,B,C) 


5. 


I(A,BC),  I(B,AC)  I(A,B,C) 
Proof;  I(B,AC)  I(B,C) 


6.  KA.BC),  I(B,C|a)  KA.B.C) 

Proof;  Ka.BC)  - I(A,B),  I(A,C)  {AB}  - {A}{B},  {AC}  - {AHC} 
I(B.cIa)  - {ABC}  - — - {A){B}{C}  ^ I(A,B,C) 

7.  I(B,c|a),  I(A,B)  -*■  I(B,AC) 

Proof;  I(A,B)  (AB)  - {A){b} 

KB.cIa)  * (ABC)  . (bHaC)  - I(B,AC) 


Ccmbinatt^yns  of  Indspendenoe  EouatioriM  | 

The  twency-two  possible  comblr*tlons  of  independence  equations  | 

are  shovm  graphically  in  Figure  2.7.  The  remaining  1,002  com-  j 

binations  of  independence  equations  are  not  possible  since  they  | 

Violate  one  of  the  relationships  above.  The  twenty-two  combine-  ! 

tions  of  independence  equations  have  been  labeled  with  numbers  in 
square  brackets  at  the  right  of  Figure  2.7.  The  first  combination 
corresponds  to  mutual  Independence  and  the  twenty-second  combination  i 

corresponds  to  mutual  dependence.  The  other  twenty  combinations  ] 

correspond  to  various  intermediate  levels  of  independence  among  ! 

three  random  variables. 

Each  of  the  combinations  of  independence  equations  is  demon-  j 

strated  below  with  a simple  example  based  on  flipping  four  types  j 

of  coins;  fair,  biased,  thick  and  magnetized  coins.  The  random  | 

variables  in  each  example  describe  whether  a head  or  tall  results  j 

from  flipping  the  coins.  These  random  variables  are  discrete,  but  j 

) 

it  is  easy  to  generalize  the  examples  to  Include  continuous  random  j 

variables.  The  twenty-two  examples  are  numbered  to  match  the  | 

twenty-two  combinations  of  Independence  assumptions  shown  in  Figure  2.7.  | 

»1  • A5  j 

— _ J 


faample  [1];  I(A,B,C),  I(A,BC),  I(B,AC),  I(C,AB),  I(A,B|c), 

I(A,c|B),  I(B,c|a),  KA.B),  I(A,C),  I(B,C) 

In  thin  example  A , B , and  C correspond  to  the  outcomes  of 
flipping  three  fair  coins.  The  Joint  probability  mass  function 
for  A , B , and  C is: 


I 


B 


H 

T 

H 

T 

H 0.125 

i 

0.125 

r 

0.125 

— 

0.125 

T j 0.125 

0.125 

j 

1 0.125 

0.125 

C 

- H 

C - 

T 

UA.l.C).  KA.iC),  1(1, AC),  1(C,AB),  I(A,B|c). 
i(a,c|b),  T(b,c|a),  i(a,b),  i(a,c),  T(b,c) 

In  this  example  A corresponds  to  the  outcome  of  flipping  a fair 
coin,  and  B and  C correspond  to  the  outcomes  of  flipping  t%re> 
magnetic  coins.  The  probability  that  a head  will  occur  when  the 
first  magnetic  coin  is  tossed  is  50Z.  However,  there  is  a 60Z 
chance  that  the  second  magnetic  coin  will  land  with  the  ssae  side 
up  as  the  first  magnetic  coin.  Neither  of  the  magnetic  coins  are 
affectedtby  the  outcome  of  tossing  the  f*Ar  coin.  The  conditional 
probabilities  for  this  example  are; 
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I 


{c-h|b-h}  - {C-T|B-T}  - 0.6 


The  Joint  probability  mass  function  for  the  three  random  variables  Is: 

C C 


H 

T 

H 

T 

H ' 0.15 

1 

0.10  I 

0.15 

0.10 

- -1 

k - . . J 

0.10 

T 0.10 

t 

1 

0.15  1 

0.15 

A - H A - T 


Example  [3]:  I(A,B,C),  I(A,BC),  I(B,AC),  I(C,AB),  I(A,B|C), 

I(A,c|b),  I(B,cIa),  I(A,B),  I(A,C),  I(B,C) 

This  example  Is  similar  to  Example  [2]  with  the  random  variables 
permuted. 

Example  [A]:  I(A,B,C),  T(A,BC),  T(B,AC),  I(C,AB),  T(A,B|C), 

I(A,C[b),  I(B,C|A),  I(A,B),  I(A,C),  I(B,C) 

This  example  Is  similar  to  Example  12]  with  the  random  variables 
permuted. 

Example  [5]:  I(A,B,C),  I(A,BC),  I(B,AC),  I(C,AB),  I(A,l|C), 

i(a,c|b),  Kb.cJa),  T(a,b),  Y(a,c),  T(b,c) 


In  thi«  example  A,  B,  and  C each  correapond  to  the  aame  flip  of  a 
fair  coin.  The  conditional  probabilities  for  thla  example  are: 

{A-H}  - 0.5 

{B-H|a-H}  - {B-t|a-T}  - 1.0 
{c-h|a-h}  - {c-t1a-t)  - 1.0 

The  Joint  probability  mass  function  for  the  three  random  variables  is 

B B 

H T H T 

I t • 

0.5  0 0 0 H 

. - ^ 

_ q ' 0 i 1 0 j)^  I T 

C - H C - T 

[6]:  T(A,B,C),  T(A,BC),  I(B,AC),  I(C,AB),  I(A,B|0, 

i(a,c|b),  T(b,c|a),  i(a,b),  T(a,c),  T(b,c) 


H 

A 

T 


In  this  exai^le,  A corresponds  to  the  outcome  of  flipping  a 
fair  coin.  If  A is  a i.«ad,  then  B and  C must  also  be  heads.  If 
A is  a tail,  then  B and  C both  correspond  to  the  same  flip  of  an- 
other fair  coin.  The  conditional  probabilities  for  this  example 
are: 


{A-H}  - 0.5 

{b-h|a-h}  - 1.0,  {B-h|A-T}  - 0.5 

{oh|b-h}  - {c-t|b-t>  - 1.0 
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A 


The  Joint  probeblllty  aase  function  for  the  three  random  verleblee  Is: 


H T 


0.5  0 


0 0 


A - H 


0.25  0 , H 


0.25  T 


A - T 


Example  [7]:  I(A.B,C),  I(A,BC),  I(B,AC),  I(C,AB),  I(A,b|c), 

T(A,C|B).  I(B,C|A),  T(A,B),  I(A,C),  I(B,C) 

This  example  Is  similar  to  Example  [6]  with  the  random  variable 
permuted. 


Example  [8];  I(A,B,C),  I(A,BC),  I(B,AC),  I(C,AB),  I(A,b|C), 

i(a,c|b),  Ycb.cIa),  i(a,b),  T(a,c),  i(b,c) 

In  this  example  C corresponds  to  the  outcome  of  flipping 
a thick  coin  (a  cylinder)  that  can  land  on  Its  edge  in  addition 
to  heads  or  tails.  Possible  outcomes  for  C are  heads  (H) , 
tails  (T) , and  edge  (F.) . A and  B correspond  to  the  outcotje 
of  flipping  two  biased  coins,  where  the  bias  of  each  coin  depends 
on  the  outcome  of  C . The  condltlomd  probabilities  for  this 


{A-H|C-H)  - 0.4,  {b-h|oh}  - 
{A-H|c-T}  - 0.5,  {b-h|c-t}  - 

{A-h|C-E}  - 0.7,  {b-h|c-e}  - 

{C-H}  - {C-T}  - 0.4,  {OE}  - 
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The  joint  probability  mass  function  for  the  three  random  varia- 
blea  is: 

B B B 


H 

T 

H T 

r 1 - - 1 

H 

T 

H 

A 

0.096 

0.064  j 

0.02 

0.18  1 

0.084 

0.056 

T 

0.144 

0.096  i 

0.02 

0.18  j 

0.036 

0.024 

C-H  C-T  OE 


It  can  be  shovn  that  this  combination  of  independence  assertions 
cannot  exist  for  three  binary  events.  Thus  it  was  necessary  for 
C to  have  three  possible  outcomes  in  the  example  above. 

UA.B.C).  T(A,BC).  T(B.AC),  I(C,AB),  i(a,b|c), 
T(a,c|b),  T(b.c|a),  i(a,b),  I(a,c),  T(b.c) 

In  this  example,  C corresponds  to  the  outcome  of  flipping  a fair 
coin.  A and  B correspond  to  the  outcomes  of  flipping  two  biased 
coins,  where  the  direction  in  which  the  coins  are  biased  depends 
on  C . The  conditional  probabilities  for  this  example  are: 

{a-h|c-h}  - {b-h|c-h}  - 0.6 
{a-h|ot}  - {b-h|c-t>  - 0.4 

{C-H}  - 0.5 

The  joint  probillty  mass  function  for  the  three  random  variables  is 


i ^ 


I 

1 


J 
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[IQ]:  I(A.B.C).  KA.BC),  I(B,AC),  I(C,AB),  I(A,B|C), 

i(a.cIb),  i(b,c|a),  T(a,b),  T(a,c),  T(b,c) 

This  exainple  is  similar  to  Example  [6]  with  the  random  variables 
permuted. 

Example  [11];  T(A,B,C),  I(A,BC),  I(B,AC),  I(C,AB),  T(A,b|c) 

i(a,c|b),  T(b.c|a).  T(a,b),  i(a,c),  T(b,c) 

This  example  is  similar  to  Exainple  (8]  with  the  random  variables  per- 
muted. 

Example  [12];  Y(A,B,C),  I(A,BC),  I(B,AC),  T(C,AB),  T(A,B|c), 

i(a,c|b),  T(b,c|a).  T(a,b),  T(a,c),  T(b,c) 

This  example  is  similar  to  Example  [91  with  the  random  varlabl>>s  pensuted. 

Example  [13]:  Y(A,B,C),  Y(A,BC),  Y(B,AC),  Y(C,AB),  Y(A,B|c), 
Y(a,c|b),  i(b,c|a),  Y(a,b),  Y(a,c),  i(b,c) 

This  example  is  similar  to  Ex.vnple  [sl  with  the  random  variables 
permuted. 
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Sample  [14];  I(A,B,C),  I(A,BC),  I(B,AC),  I(C,AB),  I(A,b|c), 

I(A,cjB),  I(B,C|A),  T(A,B),  Y(A,C),  I(B,C) 

This  example  is  similar  to  Example  [9]  with  the  random  variables 
permuted. 


Example  fl51: 


I(A,B,C),  I(A,BC),  I(B,AC),  I(C,AB),  I(A,b|c), 
I(A,c!b),  T(B,c|a),  I(A,B),  I(A,C),  I(B,C) 


In  this  example  C corresponds  to  the  outcome  of  flipping  a fair  coin. 

A and  B correspond  to  the  outcomes  of  flipping  two  magnetized  colnfi. 
where  the  direction  in  which  B is  magnetized  depends  on  C.  The  condi- 
tional probabilities  for  this  example  are: 

{C-H}  - [fl-K}  - 0.5 

(a-h|b-k,c-h}  • {a-t|b-t,c-h}  - 0.6 
{a-h|b-h,c-t}  - {A-T|b-T,OT}  - 0.4 

Ths  joint  probability’  mass  function  for  the  three  random  variables  la: 


B 

H T 


0.15 

0.10 

0.10 

0.15 

^ - 

C-H 


B 

H T 


0.10 

0.15 

0.15 

0.10 

C-T 
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.Sample  [16];  I(A.B.C),  I(A.BC),  I(B,AC),  I(C,AB),  T(A,b|c), 

i(a,c|b).  T(b.c|a),  i(a,b),  i(a,c),  T(b,c, 

In  this  example  A corresponds  to  the  outcome  of  flipping  a fair  coin. 

B and  C correspond  to  the  outcomes  of  flipping  two  .lagnetized  coins, 
where  the  outcome  of  A is  used  to  determine  how  strongly  the  coins  are 
magnetized.  The  conditional  probabilities  for  this  example  are: 

{A-H}  - {B-H}  - 0.5 

{c-h|b-h,a-h}  - {c-t)b-t,a-h}  - 0.8 
{C-h|b-H,A-T}  - {C-T|B*-T,A-Ti  - 0.6 

The  joint  probability  nuiss  function  for  the  three  random  variables  is; 


C 

H T 


0.20 

0.05 

0.05 



0.20 

A-H 


C 


H T 


0. 15 

0.10 

0. 10 

0.15 

A-T 


Example  [17]: 


Ka.b.c),  ka.bc),  i(b,ac),  i(c.ab),  T(a,b|c), 
T(a,c|b),  I(B,c|a),  I(A,B),  I(A,C),  I(B,C) 


This  example  is  similar  to  Example  [16]  with  the  random  variabler 
permuted. 
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ExHEisJlSi:  I(A.B.C),  I(A,BC),  I(B,AC),  I(C,AB),  I(A,B|c), 

I(A,C|B),  T(B,C|A),  I(A..i),  I(A,C).  I(B,C) 

In  this  example  A and  B correspoi;!  to  outcomes  of  flipping 
two  fair  coins.  C corresponds  to  the  outcome  of  flipping  a 
biased  coin  where  the  amount  that  tho  coin  Is  biased  depends  on 
A and  B , Tlie  conditional  probabilities  for  this  example  are: 


{A-a}  - {B-H}  - 0.5 
{c-h|a-t,b-t}  - 0.4 
{C-H|a-H,B-T}  - {C-HjA-T,B-H}  - 0.6 

{oh|a-h,b-h>  - 0.8 

The  Joint  probability  mass  function  for  the  three  random  varia- 
bles Is: 


B 

h T 


0.20 

0.15 

”•^^1 

0.10 

C-H 
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H T 


0.05 

0.10 

0.10 



0.15 

C-T 


Example  fl9| : 


KA.B.C),  KA.BC),  KB.AC),  KC.AB).  T(A,B|C). 
I(A,c|b),  I(B,c|a),  I(A,B),  I(A,C),  I(B,C) 


This  example  Is  similar  to  Example  [l6]  with  the  random  variables 
permuted. 
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[20];  I((A,B,C),  I(A,BC),  I(B,AC),  I(C,AB),  T(A,b|c), 

T(a,c|b),  i(b,c|a),  T(a,b),  i(a,c),  i(b,c) 

This  example  is  similar  to  Example  (l8]  with  the  random  variables 
permuted. 

Sample  [21J;  T(a.B.C).  I(A.BC),  I(B,AC).  T(C,AB),  T(A,b|c), 
T(a.c|b),  i(b,c|a),  T(a,b),  T(a.c),  i(b,c) 

This  example  Is  similar  to  Example  [18]  with  the  random  variables 
permuted. 

Example_[2^;  T(a.B.C).  T(A,BC),  T(B,AC),  T(C,AB),  T(A,B|c), 
T(a,c|b),  i(b,c|a),  T(a.b),  T(a,c),  i(b,c) 

In  this  example  t A , B , and  C , ( orreapond  to  the  outcome  of 
flipping  three  magnetic  coins.  There  Is  a 50Z  chance  that  the 
first  coin  flipped  will  come  up  heads,  there  Is  a 60Z  chance 
that  the  second  coin  flipped  lands  with  the  same  side  up  as  the 
first.  If  the  first  two  coins  are  both  heads  or  both  tails,  there 
Is  an  80Z  chance  that  the  third  coin  flipped  will  have  the  same 
outcome;  otherwise  the  probability  of  heads  on  the  third  flip  is 
50Z.  The  conditional  probabilities  for  this  example  are: 

{A-H}  - O.j 

{B‘'H|A-H)  = {b-t|a-t}  - 0.6 

{C-K|A-=H,B-H}  - {C-T|A-T,B-T}  - 0.8 
{C«'H|a-H,B-T}  - {c-h|a-t,b-h}  « 0.5 
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?he  Joint  probability  msb  function  for  tha  thrta  random  variable!  la: 

B B 


H 

T 

H 

T 

H 

0.24 

0.10 

0.06 

0.10 
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0.10 

0.06 

0.10 
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An  Additional  Relationehip  Among  the  Independence  Eouatione 

Some  of  the  combinations  of  independence  equations  require 
the  joint  distribution  for  the  three  random  variables  to  contain 
several  zeros.  This  means  that  certain  combinations  of  outcomes 
for  the  three  random  variables  are  not  possible  even  though  each 
of  the  random  variables  can  individually  assume  the  same  outcomes. 
In  Example  [5],  A , B , and  C can  each  be  heads  or  tails,  but 
it  is  not  possible  for  one  to  be  a head  when  another  is  a tall. 

If  we  assume  that  the  Joint  distribution  cannot  equal  zero 
when  the  individual  marginal  distributions  are  not  zero,  it  is 
posslb'e  to  prove  an  additional  relationehip  among  the  ten  indepen- 
dence equations. 

I(A,b|c),  I(A,C|b)  I(A,BC)  if  {BC}  + 0 

Thfe  assumption  that  (bc)  Is  not  zero  allows  va  to  divide  by  this 
quantity  in  the  following  proof : 


57 


i 

I 


I 


I(A,B|C),  I(A,C|B)  - {ABC}  - 

-►  {AC}(B}  - (ABHC)  /{AC}{B}  - /{AB}{C> 

c c 

->  fA}(B}  - (AB)  I(A,B) 
i(a,c|b),  I(A,B)  KA.BC) 

If  this  relatlonahlp  is  added  to  the  seven  discussed  above, 

It  can  be  used  to  ellmluate  four  of  the  twenty-two  possible  com- 
binations of  Independence  equations.  The  four  combinations  that 
are  eliminated  are  numbered  [5],  [6],  [7],  and  [10]  In  Figure  2.7. 
The  remaining  eighteen  combiratlons  of  independence  equations  are 
still  possible. 

Encoding  the  Tuenty-TjO  Combinatione  of  Independent  ^ Kguatione 
A subjects'  state  of  Information  about  several  uncertain 
quantities  can  be  represented  bv  a wide  variety  of  possible 
combinations  of  Independence  equations,  even  when  the  problem 
contains  as  few  as  three  random  variables.  One  of  the  princi- 
pal motivations  for  assuming  that  random  variables  are  Inde- 
pendent, Is  to  limit  the  amount  of  probability  encoding  required 
to  specify  the  joint  probability  distribution  for  all  of  the 
random  variables.  Although  there  are  many  possible  combinations 
of  independence  equations,  the  degree  of  difficulty  associated 
with  assessing  the  uncertainties  necessary  to  specify  the  joint 
distribution  can  be  determined  by  some  very  simple  properties 
of  the  Independence  equations  that  are  assumed  to  be  true» 

We  can  place  the  ten  possible  Independence  equations  for  three 


I 

; 


3 


{ 

i 
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random  variables,  in  the  four  categories  as  shovra  below; 


Category  1 

I(A,B,C)-^  {ABC}  - (A)  (B)  {C> 
I(A,BC)-»-^  (ABC)  - (A)  {BC} 

Category  2 

1 I(B,AC)-^  (ABC)  - {B}  {AC} 

^ I(C„AB)"^  {ABC}  - {C}  {AB} 
KA.bJ  C)"^  {AB|c}  - {Ajc}  {B|C} 

Category  3 

I(A,C(B)^  {ac|b}  - {a|b}  {c|b} 

I(B,C|A)^  {BC|A}  - {b|A}  ic|A} 
1(A,B)'H^  {AB}  - {A}  {B} 

Category  4 

I(A,C)'^-*  {AC}  - {A}  {C} 
I(B,C)^  {BC}  - {B}  {C} 

The  degree  of  difficulty  associated  with  assessing  the 
probabilities  needed  to  specify  the  Joint  distribution  for 
A,  B,  and  C depends  only  on  which  categories  of  Independence 
assumptions  contain  equations  that  are  assumed  to  be  true. 

As  a treasure  of  the  degree  of  difficulty  associated  with  the 


U 


assessment  problem,  we  will  assume  that  A,  B,  and  C are  each 
discrete  random  variables  with  probability  mass  functions 
that  contain  n.  possible  outcomes;  we  will  then  determine 
the  minimum  number  of  probabilities  required  to  specify 
the  joint  mass  function. 


59 


If  the  three  randoa  variables  are  assumed  to  be  mutually 
Independent  (Category  1) , then  the  joint  probability  density 


t 

functloii  can  be  determined  by  assessing  the  three  marginal 
Y distributions  and  multiplying  them  together.  To  specify 

each  of  the  probability  mass  functions,  we  would  need  to 
assess  n probabilities.  Therefore,  to  determine  the  joint 
f probability  distribution  for  A,  B,  and  C,  we  would  need  to 

assess  3n  probabilities. 

If  our  state  of  information  about  the  threk'-random  var- 

» lables  Is  such  that  we  can  not  assume  mutual  Independence, 

but  can  assume  that  one  of  the  Independence  equations  In 

Category  2 Is  true,  we  can  determine  the  joint  probability 

density  function  by  assessing  one  of  che^navgiAajkMlstrl- 

butlons  and  the  joint  distribution  for  the  two  remaining 

random  variables.  We  need  to  assess  n probabilities  to 

2 

determine  the  marginal  distribution,  and  n probabilities 
to  determine  the  joint  distribution  for  two  random  variables. 
Thus,  when  we  can  assume  that  one  of  the  Independence  equations 
In  Category  2 Is  true,  but  that  the  Independence  equatloni 
In  Category  1 Is  not  true,  we  would  need  to  assess  (n  -f  n) 
probabilities.  This  situation  occurs  for  the  combinations 
of  Independence  equations  numbered  [2],  [3],  and  [4] 

In  Figure  2.7. 
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If  our  state  of  Information  about  the  th.ee  random 
variables  Is  such  that  we  cannot  assume  that  the  Independence 
equations  In  Categories  1 and  2 are  true,  but  that  one-  of 
the  Independence  equations  In  Category  3 Is  true,  we  cai> 
determine  the  joint  probability  density  function  by  assessing 
the  marginal  distribution  from  one  of  the  three  randoiTi  vari- 
ables and  the  conditional  distributions  for  the  other  two 
random  '.arlables,  given  the  first.  In  this  situation,  we  would 

need  to  assess  n probabilities  for  the  marginal  distribution, 

2 

and  n probabilities  for  each  of  the  two  conditional  distribu- 
tions. Thus,  when  the  Independence  equations  In  Categories 
1 and  2 are  not  true,  but  one  of  the  Independence  equations 

7 

In  Category  3 Is  true,  we  will  need  to  assess  (2n*  + n) 
probabilities.  This  situation  occurs  for  the  combinations  of 
Independence  equations  numbered  [51  through  [14]  In  Figure  2.7. 

If  cur  state  of  Information  about  the  three  random 
variables  Is  such  that  none  of  the  Independence  equations 
In  Categories  1,  2,  and  3 are  true,  but  one  of  the  Indepen- 

dence equations  In  Category  4 Is  true,  then  we  can  determine 
the  Joint  density  function  by  assessing  two  margins',  distri- 
butions and  the  conditional  distribution  for  the  third  random 

variable,  given  the  first  two.  However,  to  assess  rhe  con- 

3 

dltlonal  distribution,  we  would  need  to  assess  n probabilities. 
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Since  we  can  assess  the  joint  distribution  for  all  three  ran- 

3 

dom  vatiables  with  n probabilities},  we  can  minimize  the 
number  of  probabilities  assessed  by  doing  so.  We  could  also 
assess  the  Joint  distribution  for  all  three  random  variables 
by  assessing  the  n probabilities  in  the  case  where  none 
of  the  independent  equations  are  true.  Thus,  when  none  of  the 
Independence  equations  in  Categories  1,  2,  and  3 are  true, 

3 

we  will  need  to  assess  at  least  n probabilities. 

The  number  of  probabilities  that  must  be  assessed  to 
determine  the  joint  distribution  for  all  three  random  varl^  ■ 
ables  Ij  summarized  in  the  following  table  as  a function 
of  the  categories  of  independence  equations. 


Categories  of 

Independence 

Equations 

1 

2 

3 

A 


Number  of 

Probabilities 

Ass<»ssed 

3n 

n^  + n 

+ n 
3 


The  number  of  probabilities  that  must  be  assessed  to 
determine  the  joint  distribution  is  a rough  measure  of  the 
degree  of  difficulties  associated  with  the  encoding  process. 
For  a three  variable  problem  with  continuous  probability  den- 
sity functions  or  discrete  mass  functions  with  many  possible 
outcomes,  cases  corresponding  to  large  values  of  n,  , mutual 
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Independence  (Category  1)  or  partial  Independence  (Categories 
2 and  3)  can  he  powerful  simplifying  assumptions.  Where  more 
than  three  variables  are  Involved  the  Independence  as'^tunptlons 
are  even  more  powerful. 

2.2.2  Coalescence 

Coalescence  Is  a process  of  eliminating  redundant  portions 
of  decision  trees.  Coalescence  Is  the  key  to  solving  large 
complex  dficlnlon  pioblems  that  would  require  a prohibitive  amount 
of  probability  encoding  and  processing  If  the  redundancies 
were  not  eliminated.  The  redundancies  occur,  and  coalescence 
becomes  possible,  when  two  or  more  sections  of  a decision 
tree  contain  exactly  the  same  structure  and  numerical  data 
(probabilities  and  values)  . However,  for  two  sections  of  a 
decision  tree  to  have  the  same  probabilities,  the  probab- 
ilities must  correspond  to  random  variables  which  are  Inde- 
pendent of  other  random  variables  and  decisions  represented 
In  the  decision  tree.  Thus,  the  use  of  coalescence  to  simplify 
a decision  tree  requires  an  understanding  to  the  Independ- 
encies that  exist  among  the  random  variables. 

Although  a decision  tree  specifies  the  probabilistic 
structure  of  a decision  problem.  It  does  not  do  a good  Job 
of  describing  the  Independencies  among  random  varlbU.«v» 
and  decisions.  If  two  random  variables  In  a decision  tree 


are  Independent  the  probabilities  associated  with  one  random 
variable  are  different  in  portions  of  the  tree  that  corres- 
pond to  different  outcomes  for  the  other  random  varlakie.. 

The  necessity  to  search  the  tree  to  discover  dep  jndencles 
i^kes  it  very  difficult  to  visualize  or  alter  the  indepen- 
dence assumptions  in  the  decision  tree  formed. 

Influence  Dicuframe 

To  overcome  this  difficulty,  a procedure  has  been  developed 
for  describing  the  dependencies  among  random  variables  and 
decisions  in  the  form  of  an  "Influence  diagram."  An  influ- 
ence diagram  can  be  used  to  specify  and  visualize  the  pro- 
babilistic dependencies  in  a decision  analysis,  and  to  deter- 
mine the  degree  of  coalescence  that  is  possible  in  the 
corresponding  decision  tree.  Using  influence  diagrams  an 
analyst  can  take  full  advantage  of  coalescence  to  minimize 
both  the  assessment  of  probabilities  and  the  amount  of  compu- 
tation required  to  solve  the  decision  tree. 

Figure  2.8  shows  how  influence  diagrams  represent  the 
dependencies  among  random  variables  and  decisions.  A random 
variable  is  represented  by  a circle  containing  its  name  or 
number,  and  a decision  is  represented  by  a square  containing 
its  name  or  number.  An  arrow  pointing  from  random  variable 
A to  random  variable  B means  that  the  outcome  of  A can 
Influence  the  probabilities  associated  ffith  B,  An  arrow 
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1 


A 


B 


THE  PROBABILITIES  ASSOCIATED  WiVh  'RANDOM 
VARIABLE  B DEPENDS  ON  THE  OUTCOME  OF 
RANDOM  VARIABLE  A 


THE  PROBABILITY  OF  RANDOM  VARIABLE  D 

depends  on  decision  C. 


the  decision  maker  knows  the  outcome  of 

RAOOM  VARIABLE  E WHEN  DECISION  F IS  MADE 


THE  DECISION  MAKER  KNOWS  DECISION  G WHEN 
DECISION  H IS  MADE. 


FIGURE  2.8  DEFINITIONS  USED  IN  INFLUENCE  DIAGRAMS 


r 
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pointing  to  a decision  from  p.ither  another  decision  or  a 
random  variable  means  that  the  decision  is  made  with  the 
knowledge  of  the  outcome  of  the  other  decision  or  random 
variable.  A connected  set  of  squares  and  circles  is  called 
an  influence  diagram  because  it  shows  how  random  variables 
and  decisions  influence  each  other. 

Figure  2.9  shows  a simple  example  of  an  Influence  diagram 
in  which  all  the  nodes  represent  random  variables.  In  this 
example  A influences  B,  and  B Influences  C.  If  we 
do  not  know  the  outcome  of  B,  the  probabilities  associated 
with  C depends  on  the  outcome  of  A.  However,  if  we  know  the 
outcome  of  B,  the  probabilities  associated  with  C do 
not  depend  on  the  outcome  of  A.  Ju  other  words,  A affects 
the  probabilities  associated  with  C through  its  influence 
on  B but  once  we  know  the  outcome  of  B the  outcome  of  A 
is  irrelevant.  Figure  2.9  also  shows  how  an  Influence  diagram 
is  translated  into  a decision  tree.  In  the  tree  at  the 
bottom  of  Figure  2.9  the  probabilities  assoc .'.ated  with  C do 
not  depend  on  the  outcome  of  A.  Thus,  the  same  probability 
is  attached  to  the  corresponding  branches  of  node  C that 
follow  the  same  outcome  for  B. 


i; 

.J 
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Since  some  of  the  branches  In  this  probability  tree 
contain  the  same  information,  they  can  be  combined,  or 
coalesced".  The  coalesced  decision  tree  for  this  example 
is  shown  in  Figure  2.10.  It  contains  the  same  information 
as  the  decision  tree  in  Figure  2.9  but  has  fewer  nodes  and 
branches.  If  the  process  of  coalescence  is  carried  out  at 
the  time  the  decision  tree  is  generated,  the  size  of  the  model 
can  be  greatly  reduced.  Computer  programs  havs  been  developed 
that  translate  directly  from  influence  diagrams  to  coalesced 
decision  trees. 

In  a typical  application  of  influence  diagrams,  a decision 
tree  with  millions  of  nodes  was  reduced  to  one  with  fewer 
than  a thousand  nodes.  The  influence  diagram  for  this  appli- 
cation is  shown  in  Figure  2.11.  The  corresponding  decision 
tree  contain  a complex  set  of  interconnected  branches.  The 
left  hand  portion  of  the  decision  tree  is  nearly  conventional 
with  the  number  of  branches  growing  geometrically  for  each 
additional  state  or  decision  variable;  however,  the  rlghthand 
portion  coalesces  rapidly  to  relatively  few  nodes  near  the  end  of  the  tree 
Number  of  Reguived  Prolyihilitu  Aeeeemente 

In  addition  '.o  providing  a way  to  visualize  the  depen- 
dencies among  many  uncertain  ev-nts,  and  drastically  reducing 
the  size  of  the  decision  tree,  influence  diagrams  also  show 
the  number  of  probability  assessments  that  are  required  by 
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the  model.  If  each  random  variable  has  N different  out- 


comes, and  a particular  random  variable  Is  directly  Influenced 
by  M other  events  or  decisions,  then  It  will  be  necessary 
to  assess  probability  distributions  In  order  to  describe 

the  uncertainty  assoclc«-''d  with  the  random  variable. 

Direction  of  Arrows  in  Influence  Diagrcana 

The  direction  of  the  arrows  In  an  Influence  diagram  Is 
significant,  and  In  general  they  cannot  be  reversed  without 
It  changing  the  Independence  assumptions  Implied  by  the 
diagram,  even  though  dependence  Is  Inherently  non-dlrec- 
tlonal.  The  arrows  In  the  Influence  diagram  cannot  be  rever- 
sed because  they  Indicate  both  the  Independencies  MWng  random 
variables  and  the  state  of  Information  for  which  the  Inde- 
pendence assumptlocs  are  true. 

For  example,  the  Influence  diagram  In  Figure  2.9  means 
that  C Is  Independent  of  A given  B.  However,  If  we 
modify  the  Influence  diagram  In  Figure  2 9 by  reversing  one  of 
the  arrows,  as  shown  In  Figure  2.12  this  statement  Is  no 
longer  true,  i'e  Influence  diagram  In  < Figure  2.9  allows 
us  to  write 

{ac|b}  -{a|b}{c|b} 

On  the  other  hand,  the  Influence  diagram  in  Figure  2.12 
allows  us  to  write 

{AC}  - ^A>  (C) 

I 


71 


The  arrows  In  the  Influence  diagram  in  Figure  2.*^  show  that  we 
must  Include  the  knowledge  of  the  . ndom  variable  B .as. part 
of  our  state  of  Information  when  ass  ting  that  A and  C 
are  Independent.  However,  the  arrows  . i the  Influence  diagram 
in  Figure  2.12  ahow  that  the  Independence  between  A and  C 
occurs  before  the  outcome  of  random  variable  B is  Included 
in  our  state  of  information. 

Generating  a Deaieion  Tree  from  an  Influence  PiacpKan 

To  generalize  these  observations  we  need  to  formalize 
the  procedure  for  translating  from  an  influence  diagram  to 
a decision  tree.  We  require  that  Influence  dlagrame  contain 
no  loops,  so  there  must  be  at  least  one  node  in  the  influence 
diagram  that  does  not  have  any  arr6vs  pointing  toward  it. 

If  there  is  only  one  such  node,  then  the  random  variable 
or  decision  corresponding  to  this  node  is  placed  at  the 
beginning  ci  the  decision  tree.  If  there  are  several  nodes 
which  do  not  have  arrows  pointing  to  them  and  some  of  them 
represent  decisione,  we  can  place  any  one  of  these  decisions 
at  the  beginning  of  the  decision  tree.  If  none  of  the  noden 
that  have  no  arrows  pointing  toward  them  represent  declsldr.s, 
we  can  place  any  one  of  the  corresponding  random  varl<[.bles 
at  the  beginning  of  the  decision  tree.  Once  we  have  deter- 
mined the  first  node  in  the  decision  tree,  we  can  remove 
the  corresponding  node  from  the  influence  diagram  along 
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with  all  the  arrows  that  leave  thxa  node. 

After  we  detemliie  the  first  node  In  the  decision  tree 
and  remove  the  corresponding  node  from  the  Influence  diagram, 
we  can  use  the  same  procedure  to  determine  the  second  level 
of  the  decision  tree;  the  second  level  consists  of  all  the 
nodes  attached  to  branches  leaving  the  first  node  of  the  tree. 
The  reduced  Influence  diagram  (the  Influence  diagram  that 
remains  after  the  node  corresponding  to  the  first  random 
variable  or  decision  In  the  decision  tree  Is  removed)  must 
contain  at  least  one  noue  which  does  not  liave  any  arrows 
pointing  toward  It.  If  there  Is  only  one  such  node,  the 
decision  or  random  variable  corresponding  to  this  node  Is  * 
placed  In  the  second  level  of  the  decision  tree.  If  the 
reduced  Influence  diagram  contains  more  than  one  node  with 
no  arrows  pointing  toward  It,  and  some  of  those  nodes  corres- 
pond to  decisions,  any  one  of  those  decisions  can  be  placed 
at  the  second  level  of  the  decision  tree.  However,  If  all 
of  the  nodes  that  have  no  arrows  pointing  toward  them  repre- 
sent random  variables,  tnen  any  one  of  these  random  variables 
can  be  placed  at  the  second  level  of  the  decision  tree.  Once 
a decision  or  random  variable  has  been  placed  at  the  second 
level  of  the  decision  tree,  the  corresponding  node  is  removed 
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frow  the  Influence  diagram,  The  same  procedure  is  then  used 
to  determine  the  decision  or  random  variable  to  be  placed 
at  the  third  level  of  the  decision  tree. 

For  example,  If  this  procedure  were  applied  to  the  Influ- 
ence diagram  shown  In  Figure  2.13  one  of  the  many  possible 
orders  In  which  the  nodes  could  be  placed  In  a decision  tree 
Is  shown  by  the  numbers  In  Figure  2.13.  Alternatively, 
the  same  Influence  diagram  can  be  translated  Into  a declsl>>n 
tree  with  the  nodes  2 and  3 reversed,  or  with  nodes 
6 and  7 reversed.  In  fact,  there  are  many  other  possible 
ways  that  the  Influence  diagram  In  Figure  2.13  can  be  translated 
Into  a decision  tree.  However,  all  of  the  resulting  decision 
trees,  though  different,  would  produce  the  same  sets  of 
optimum  decisions  and  same  expected  values  at  the  beginning 
of  the  tree. 

Further  research  Is  needed  before  we  will  have  a com- 
plete understanding  of  the  meaning  of  Influence  diagrams. 

It  Is  possible  to  draw  Influence  diagrams  that  cannot 
be  translated  directly  Into  a decision  tree  using  the  rules 
given  above.  For  example,  consider  the  Influence  diagram 
shown  In  Figure  2.14a.  If  we  were  to  follow  the  rules  given 
In  the  precadlng  paragraphs,  we  would  find  that  the  decision 
tree  corresponding  to  this  Influence  diagram  Is  the  one  shown 
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in  Figure  2.14b.  In  this  case,  the  randon  variables  and  decisions 
Hust  be  placed  in  a decision  tree  in  the  order  shown.  The  diffi- 
culty with  the  decision  tree  shown  in  Figure  2.14b  is  that  the 
decisions  taken  at  node  3 may  depend  on  the  outcome  of  the  random 
variable  corresponding  to  node  1,  even  though  the  influence  diagram 
in  ligure  2.14a  shows  rhat  node  j does  not  depend  directly  on  node 
1.  On  the  other  hand,  if  we  attempt  to  coalesce  the  decision  nodes 
in  Figure  2.14b  so  that  they  do  not  depend  on  the  outcome  of  the  random 
variable  corresponding  to  node  1,  then  we  will  not  know  the  state 

of  this  random  variable  when  we  reach  the  nodes  at  the  end  of  the 
decision  tree. 

Ih.  proper  way  to  gaa.rate  a daclalon  trao  the  Influeace 
diagram  ahown  In  Figure  2.14a  la  to  uae  Bayea'  rule  to  reverae  the 
order  ol  random  varlablea  1 and  2 and  then  place  vandom  variable  1 
alter  declalon  3 In  the  tree.  In  the  nrjtt  nhaae  ol  our  reaearch,  we 
hope  to  develop  general  algorithms  lot  tranalatlng  any  Inlluence 
diagram  into  a consistent  decision  tree. 
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Ihg,  Value  of  Declslon-DependPnt-  ^ ^ 


The  idea  of  valuing  perfect  information  has  appeared  in  many 
treatments  of  decision  making  under  uncertainty.  Most  often  the 
example  being  treated  represents  a simple  hypothetical  situation. 
The  informational  structure  that  is  being  captured  in  probability 
assignments  is  straightforward  and  the  assumptions  regarding  the 
probabilistic  structure,  such  as  types  of  independence  among  both 
controlled  and  uncontrolled  variables,  are  implicit  in  the 


problem  statement.  However,  the  correct  computation  of  the  value 
of  information  can  be  elusive  on  both  conceptual  and  numerical 
bases.  The  concept  of  clairvoyance  will  lead  us  to  the  construc- 
tion of  detailed  Informitlon  models  and  to  the  exploration  of 
their  precise  interpretation  and  use. 

The  Primary  Decision 

For  lUustrstlon,  let  ua  pla,  the  role  of  analysts  for  a space 
=lsslo„  designed  to  land  a remotely  controlled  experimental  appa- 
ratus on  the  surface  of  Mars.  He  have  thoroughly  analyzed  the 
mission  and  have  s-marlzed  our  total  state  of  inforiMtlon  by 
assigning  a 0.6  probability  that  the  Mars  mission  will  be  success.ul 
and  a corresponding  0.4  probability  that  It  will  be  a failure. 

Also  we  have  analyzed  the  values  to  be  derived  from  the  mission  and 
have  put  them  m monetary  units,  mllllons-of-dollars.  for  example. 
Lefs  assume  that  the  value  of  a successful  Mars  mission  Is  50  units 
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and  the  value  of  an  unsuccessful  one  Is  10  units.  A positive  value 
might  be  attributed  to  a failure  because  attempting  the  mission  hAs 
Important  social  value  and  even  a failure  vill  provide  knowledge  for 
a better  design  on  the  next  attempt. 

Unexpectedly,  several  months  before  launch  another  nation 
announces  that  it  will  attempt  a similar  mission  to  Venus  In  about 
one  year.  Because  of  the  competitive  nature  of  the  space  race  and 
the  Important  foreign  policy  implications  of  technological  leader- 
ship, we  realize  that  the  value  of  changing  our  destination  and 
successfully  landing  on  Venus  would  be  quite  high.  On  the  other 
hanc,  if  we  attempt  to  land  on  Venue  and  fall  \?e  would  look  fodish 
for  diverting  the  program,  and  in  any  case  we  would  set  back  the 
timetable  on  our  extensive  Martian  exploration  program  at  least 
two  years.  When  all  of  these  factors  are  evaluated  we  find  that  a 
successful  landing  on  Venus  is  worth  100  units  and  a failure  costs 
10  units.  To  our  surprise,  when  we  check  the  feasibility  of  diverting 
the  mission  we  find  that  because  of  modular  design  only  a few  impor- 
tant but  thoroughly  tested  components  of  the  landing  system  need 
to  be  changed,  and  the  mission  engineers  assign  a J.6  probability 
of  success  regardless  of  destination. 

From  these  assessments,  we  can  lay  out  the  primary  decision  tree 
of  Figure  2.15.  Along  each  outcome  branch  emanating  from  a chance  node 
we  have  written  the  conditional  probability  of  following  that  path, 
and  near  each  node  we  have  written  the  value,  either  assigned  or 
derived,  of  being  at  the  point  iu  the  program  represented  by  that  node. 
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We  see  that  the  expected  value  of  going  to  Mars  is  34,  while  the 
expected  value  of  going  to  Venus  is  56.  Thus,  in  order  to  maximize 
the  expected  value  of  the  mission  we  decide  to  go  to  Venus. 

Vatue  of  Perfect  Information 

We  might  wish  to  use  the  decision  tree  to  investigate  the 
possibility  of  gathering  new  information  before  we  make  the  final 
decision.  To  do  this  we  can  use  the  value  of  perfect  information 
as  an  upper  boind  for  the  value  of  less  complete  information 
gathering  program.  Most  analysts,  when  presented  with  Figure  2.15 
and  asked  to  derive  the  value  of  perfect  Informafion,  reverse  the 
order  of  decision  and  chance  nodes  in  Figure  2.15  to  produce  the  tree 
shown  in  Figure  2,16.  With  the  latter  tree  we  learn  first  whether 
the  mission  will  succeed  or  fail  and  then  we  decide  on  the  destina- 
tion. If  we  know  the  mission  will  succeed,  v»e  send  it  to  Venus  for 
100  units  of  value,  and,  if  it  will  fall,  we  send  it  to  Mars  for  10 
units  of  value.  Using  the  original  probability  of  success  (0.6)  as 
the  probability  that  the  information  will  predict  a success,  we 
obtain  an  expected  value  of  64  units  with  perfect  information.  Sub- 
tracting 56  units  for  the  value  of  the  primary  decision  problem,  we 
obtain  8 units  for  the  value  of  perfect  information. 

What  might  be  wrong  with  this  approach?  Suppose  that  perfect 
information  revealed  that  i:,e  mission  would  succeed  on  Mars  but  fail 
on  Venus,  or  vice-versa.  These  possibilities  do  not  appear  in  Figure 
2.16.  To  correct  this  omission  we  might  draw  a new  tree  for  the  value 
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with  per£v?ct  Information  as  illustrated  in  Figure  2,17.  First  we 
learn  one  of  four  possible  predictions  consisting  of  the  four  combi- 
nations of  success  or  failure  on  Mars  and  Venus,  Then  we  make  the 
best  decisions  given  this  Information,  as  Indicated  in  the  decision 
tree. 

In  order  to  assign  probabilities  one  might  reason  that,  since 
landings  on  Mars  or  Venus  appear  in  separate  portions  of  the  primary 
tree  of  Figure  2,x5,  the  events  must  be  Independent  and  the  proba- 
bilities should  be  multiplied  as  shown  in  Figure  2,17,  This  will 
yield  a value  of  73.6  with  perfect  information,  and  subtracting  the 
56  unit  value  of  the  primary  decision  it  yields  a 17.6  value  of 
perfect,  information. 

However,  the  Independence  assumption  must  be  questioned.  Since 
we  can  only  send  the  mission  to  a single  destination,  might  the  events 
be  mutually  exclusive?  If  we  simply  try  to  assign  the  probabilities 
directly  we  are  tempted  to  phrase  confusing  questions  like  "What  is 
the  probability  we  will  succeed  on  both  Mars  and  Venus?"  or  "If  we 
learned  we  had  failed  on  Mars  what  probability  would  we  assign  to 
success  on  Venus?"  The  trouble  stems  from  the  fact  that  we  have 
only  one  rocket  and  it  is  difficult  to  consider  sending  it  to  both 
destination  simultaneously,  but  this  consideration  seems  to  be 
necessary  in  order  to  assign  the  required  probabilities.  Perhaps 
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we  could  retreat  to  e "classical"  interpretation  in  which  we  con- 
struct many  "identical"  hypothetical  worlds  where  some  rockets  are 
sent  to  Mars  and  others  are  sent  to  Venus.  With  much  thought  and 
careful  phrasing  we  might  arrive  at  clear  questions  with  useful 
interpretations.  But  we  might  still  wonder  if  we  had  come  up  with 
a valid  assessment. 

The  Concept  of  C cairvoi^anae 

These  confusing  questions  of  probability  assessment  can  be 
resolved  with  the  introduction  of  the  clairvoyant,  a hypothetical 
character  who  knows  all  and  vho  can  answer  any  well-specified  ques- 
tion about  any  uncertainty.  Of  course,  we  shall  never  really  be 
able  to  obtain  answers  from  him,  but  our  probability  assignments  for 
his  possible  answers  will  provide  the  key  to  probabilistic  structuring. 

In  the  example  at  hand,  if  we  were  to  ask  the  ciain^oyant 
whether  the  mission  will  succeed  or  fall,  he  might  respond  by  saying 
that  the  result  could  depend  on  where  you  sent  it.  Thus,  we  would 
be  led  to  asking  him  two  such  questions,  one  for  ecch  destination. 

To  make  our  questions  precise  we  might  draw  up  the  questionnaire  of 
Figure  2.18.  Presuming  that  the  clairvoyant  is  satisfied  with  our 
definitions  of  success  and  failure,  he  could  answer  by  checking  one 

box  in  each  row  corresponding  to  the  outcome  he  foretells  for  each 
destination  choice. 

Before  we  engage  the  clairvoyant,  we  wish  to  calculate  the  value 
of  his  services  in  monetary  units,  the  value  of  clairvoyance.  Since 
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DESTINATION 


MISSION 


FAILURE 


SUCCESS 


Cfeck  one  box  in  each  row 


Figure  2.18:  CLAIRVOYANT'S  REPORT  FORM 
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the  clairvoyant  has  two  possible  answers  for  each  of  the  two 
questions  there  are  four  possible  reports  for  Mars  and  Venus: 
failure,  failure;  failure,  success;  success,  failure;  success, 
success.  We  now  must  assign  probabilities  to  these  reports. 

A possible  probability  assignment,  compatible  with  our  original 
assignments  of  Figure  2.15,  is  illustrated  in  Figure  2.19.  This 
distribution  Implies  dependence  between  our  knowledge  of  the 
clairvoyant's  two  answers.  For  example.  If  he  were  to  answer  sue* 
cess  on  Mars,  we  would  then  assign  a 0.554/0.6  - 0.923  probability 
that  he  would  also  answer  success  on  Venus. 

Philosophically,  the  Important  aspect  of  thlf  formulation  Is 
that  we  are  assigning  probabllltes  to  events  that  could  occur  Imne- 
diately,  when  the  coalrvoyant  reveals  his  answers.  Also,  we  have 
avoided  the  awkward  considerations  of  sending  our  single  spacecraft 
simultaneously  to  both  planets  or  of  generating  hypothetical  universes. 

We  now  apply  this  probability  assignment  by  constructing  the 
decision  tree  of  Figure  2.20.  The  initial  chance  node  represents 
the  clairvoyant's  revelation  of  one  of  the  four  possible  reports, 
each  Indicated  by  the  abbreviated  report  form  on  one  of  the  following 
branches.  The  probabilities  of  Figure  2.20  are  asslgried  to  these 
reports.  Following  each  report  we  must  make  the  best  decision  using 
the  values  from  Figure  2.15.  Having  made  the  decisions  Indicated 


by  the  arrows,  we  find  that  the  expected  value  with  clairvovance — 
but  before  the  clairvoaynt  reveals  his  answer— is  65,84.  Subtracting 
the  56  unit  value  of  the  primary  decision  (without  clairvoyance) 
yield  a value  of  clairvoyance  of  9.84. 
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It  would  be  rare  for  experts  to  think  in  terms  of  Joint  proba- 
bility distributions  such  as  those  of  Figure  2,19,  Normally,  the 
experts  will  have  technical  information  organized  in  a way  that  is 
meaningful  to  them,  and  it  1s  desirable  to  construct  the  probability 
model  in  their  terms,  A simple  version  of  such  a model  is  illus- 
trated by  the  probability  assignment  model  of  Figure  2.21.  Here  the 
first  question  asked  of  the  clairvoyant  is,  "Will  the  launch  system, 
which  is  common  to  both  destinations,  work?"  The  expert  has  assigned 
0.65  to  the  answer  "WORK".  The  next  two  questions  depend  on  the 
destination.  The  first  is  "If  we  launch  successfully  and  send  the 
spacecraft  to  Mars,  will  the  landing  systems  work?"  The  expert 
assigns  a probability  of  60/65  to  a positive  answer.  For  the  corres- 
ponding Venus  question,  the  expert  also  assigns  a probability  of  60/65, 
(In  general,  these  assignments  need  not  be  equal.)  The  expert  has 
also  stated  that  given  a successful  launch,  information  about  the 
clairvoyant's  report  for  the  landing  system  for  one  destination  will 
not  influence  his  probability  assignment  for  the  other  destination; 
the  probability  assignments  to  these  events  are  conditionally  inde- 
pendent. From  this  probability  assignment  model  we  can  calculate 
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the  joint  probability  distribution  for  the  clairvoyant’s  report  of 
success  or  failure  for  the  two  possible  missions  (see  Figure  2.19), 
For  example,  the  probability  that  the  clairvoyant  will  report  success 
on  both  planets  is: 


0.65 


60 

65 


60 

65 


0.554 


Figure  2.21  is  similar  to  what  is  conmionly  called  the  probability 
assignment  tree,  except  that  these  trees  usually  do  not  Include 
possible  oependencles  of  probability  assignments  on  decisions. 

Further  Implications  of  the  Probability  Aseignment  Model 

The  construction  of  a formal  probability  assignment  model  often 
raises  new,  Interesting  and  useful  informational  questions.  While 
the  value  of  clairvoyance  on  the  uncertainties  appearing  in  the 
primary  decision  tree  is  an  upper  limit  for  the  value  of  any  corres- 
ponding information  gathering  program,  often  the  most  feasible 
information  gathering  programs  are  directly  related  to  the  uncer- 
tainties appearing  in  the  probability  assignment  model.  Thus,  this 
model  naturally  leads  to  new  and  more  practical  information  valuation 
questions . 

For  example,  in  the  space  mission  problem  we  may  be  able  to 
conduct  exhaustive  experiments  on  replicas  of  the  launch  system  and 
make  elaborate  tests  on  the  actual  launch  vehicle.  The  value  of 
clairvoyance  on  the  launch  system  alone  is  a straightforward  calcu- 
ation  from  the  information  we  have  built  up. 
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The  computation  in  Figure  2.22  shows  that  the  value  with  clair- 
voyance on  the  launch  system  is  63  units.  Subtracting  the  56  unit 
value  of  the  primary  decision,  we  arrive  at  a 7-unlt  value  of  clair- 
voyance on  the  launch  system  only.  Since  most  of  the  9,84  value 
of  complete  clairvoyance  can  be  derived  from  the  more  practical 
launch-system  Information,  it  would  be  best  to  start  a realistic 
Information  gathering  program  with  a study  of  the  launch  system. 
Deoision  Dependent  Clairuo^anoe 

We  may  also  wish  to  consider  clairvoyance  for  only  one  of  the 
decision  alternatives.  For  example,  suppose  we  engaged  the  clair- 
voyant to  tell  us  only  whether  we  will  succeed  or  fall  if  we  send 
the  spacecraft  to  Mara.  The  primary  decision  tree  of  Figure  2.15 
and  the  probability  assignment  model  of  Figure  2.21  glvfc  us  all 
the  information  we  need  to  construct  the  tree  for  the  value  with 
clairvoyance  about  Mars,  shown  in  Figure  2.23.  Once  we  get  the 
clairvoyant's  report  on  the  success  of  the  Mars  mission,  we  must 
recalculate  the  probability  of  success  on  Venus  because  of  the 
dependency  in  our  Joint  probability  assignment  (which  results  from 
the  common  launch  system) . A report  of  a successful  Mars  mirision 
results  in  a revised  probability  of  0.923  for  success  on  Venus.  A 
report  of  failure  if  we  go  to  Mn^s  revises  the  probability  of  failure 
on  Venus  to  0.885.  Using  thdse  probabilities,  we  find  the  expected 
values  shown  in  Figure  2.23.  Contrary  to  our  intuition,  we  find 
that  a clairvoyant's  report  of  a successful  Mars  mission  indicates 
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that  we  should  send  the  mission  to  Venus,  and  that  a report  that  we 
will  fall  on  Mars  Indicates  thsL  we  should  send  the  mission  to  Mars, 

This  Is  the  phenomenon  of  decision-dependent  Information,  In- 
lormatlon  about  one  aspect  of  a problem  may  have  surprising  Impli- 
cations for  Intuitively  separate  aspects  of  the  problem  due  to 
dependencies  In  the  probabilistic  Informational  structure.  In 
complex  problems,  a formal  evaluation  Is  the  only  way  to  determine 
the  correct  Inferences  and  their  Implications. 

In  order  to  capture  these  effects,  the  analysis  must  not  only 
represent  the  primary  problem  structure,  (Figure  2.15),  but  It  must 
also  capture  the  Informational  structure  In  a formal  model,  (Figure 
2.21),  In  many  problems  the  Informational  model  may  provide  the 
m. re  natural  and  more  productive  focus  for  analysis.  In  the  space- 
craft example,  we  can  derive  the  primary  decision  tree  and  all  the 
Informational  trees  from  the  single  probability  assignment  model  by 
adding  only  the  decision-event  chronology  to  apply  to  each  case. 

This  approach  to  analysis  might  provide  a key  to  more  effective 
computer  aids  to  the  model  building  process,  (See  Section  2,3,2, 
Analysis  of  Decision  Trees,) 

Unequal  Deaiaion-Dependent  Probabilities 

The  calculations  demonstrated  above  work  equally  well  when  the 
probabilities  for  success  on  Mars  and  Venus  are  not  equal.  We  can 
demonstrate  this  fact  by  replacing  the  probabilities  In  Figure  2.21 
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with  a "launch  system  working"  probability  of  0.75,  a "Mars  landing 
system  works"  probability  of  70/75  and  a "Venus  landing  system  works 
rpobabilicy  of  50/75.  In  the  primary  decision  tree  of  Figure  2.15 
this  results  in  a "Mara  success"  probability  of  0.7  and  a "Venus 
success"  probability  of  0.5.  The  results  with  these  new  probability 
assignments,  as  well  as  the  original  ones,  appear  in  Table  2.1  along 
with  additional  clairvoyance  values  for  both  landing  systems  and 
Venus  mission  only. 

Cona 'usion 

We  have  seen  that  a probability  assessment  model  built  on  the 
concept  of  clairvoyance  clarifies  the  interpretation  and  specifica- 
tion of  probability  assignments  and  precisely  determines  values  of 
clairvoyance.  It  also  adds  precision  to  the  subjective  interprets- 
tion  and  assessment  of  probability.  In  problems  where  uncertainty 
plays  a key  role,  emphasis  on  the  construction  of  a formal  informa- 
tional model  can  clarify  communication  and  lead  to  a more  rapid  and 
accurate  solution. 

Further  research  is  needed  to  de/elop  a precise  and  convenient 
notational  system  for  dealing  with  probability  assessment  models. 

The  existing  inferential  notational  systems  are  too  cumbersome  and 
the  existing  graphical  representations  are  Incomplete.  The  general 
problem  of  specifying  and  translating  between  probability  assess- 
ment trees  and  trees  specifying  the  actual  sequence  of  decisions 
and  events  is  discussed  in  Section  2.3.2,  Analysis  of  Decision  Trees. 
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EQUAL  PROBABILITIES  UNEQUAL  PROBABILITIES 


CLAIRVOYANCE 

ABOUT 

Value  with 

Value  of 

Value  with 

Value  of 

Nothing 

56 

0 

45 

0 

Everything 

65.84 

9.84 

64.33 

19.33 

Launch  System 

63 

7.0 

50 

5 

Landing  System 

59.38 

3.38 

61 

16 

Mars  Only 

58.94 

2.94 

47.34 

2.34 

Venus  Only 

65.84 



9.84 

64.33 

19.33 

Table  2.1 

SUMMARY  OF  SPACE  MISSION  EXAMPLE  NUMERICAL 
RESULTS  WITH  ORIGINAL  (EQUAL)  PROBABILITIES 
AND  NEW  (UNEQUAL)  PROBABILITIES 


2.2.4  The  Value  of  Sequential  Information 


Using  decision  analysis  it  is  possible  to  calculate  the  value 
of  one  or  more  pieces  of  information — called  "observables" — when 
a decision  must  be  made  in  the  face  of  undertainty.  This  information 
has  value  because  it  can  affect  the  decision  and  lead  to  a greater 
expected  profit.  Hdwever,  the  possibility  of  buying  Informa'ilon 
sequentially  presents  the  decision  maker  with  a set  of  secondary 
decisions:  which  observables  should  he  buy  and  in  which  order 

should  he  buy  them?  It  is  possible  that  knowing  one  observable 
affects  not  only  the  primary  decision,  but  also  the  decision  to  buy 
additional  information.  In  that  case  the  value  of  knowing  the  first 
observable  la  greater  than  it  would  be  if  it  affected  only  the 
primary  decision.  The  prices  of  the  observables  affect  the  decision 
maker’s  willingness  to  buy  additional  information.  For  this  reason 
the  amount  that  the  value  of  learning  each  observable  is  increased 
by  the  possibility  of  buying  additional  Information  depends  on  the 
prices  of  all  the  observables. 

When  the  prices  of  all  the  observables  can  be  added  to  deter- 
mine the  price  of  any  combination  of  observables  and  when  all  the 
prices  are  known  with  certainty,  we  can  formulate  the  general  sequen- 
tlal  information  problem  in  terms  of  a set  of  state  variables 
(Xi,...,Xm)  and  a set  of  observables  (y^^ y^)  with  a corresponding 

set  of  observable  prices  (K  K ) . When  an  observable  is  equal 

^1  ^n 

to  one  of  the  state  variables  it  represents  perfect  information. 
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However,  by  treating  observables  and  state  variables  separately,  we 
can  also  deal  with  Imperfect  Information. 

To  solve  for  the  value  of  Information  when  all  of  the  observa- 
bles can  be  learned  sequentially,  we  need  to  solve  the  decision  tree 
shown  In  Figure  2.24.  For  a large  decision  problem  It  would  be  very 
difficult  and  tedious  to  generate  this  decision  tree.  However,  the 
tree  has  a very  repetitive  structure  that  can  be  easily  Implemented 
as  part  of  an  automated  decision  aid  for  generating  decision  trees. 
Instead  of  the  entire  tree  shown  In  Figure  2.24,  the  user  specifies 
the  decision  tree  that  exists  when  information  cannot  be  purchased 
sequentially  and  then  asks  th3  computer  program  to  expand  the  tree 
to  Include  sequential  Information. 

The  computer  program  starts  the  expanded  decision  tree  with  a 
decision  node  such  as  that  shown  at  the  left  of  Figure  2.24,  The 
alternatives  at  this  node  are  to  buy  any  one  of  the  specified  set 
of  observables  or  proceed  to  the  basic  decision  tree  without 
buying  Information.  The  last  alternative  leads  directly  to  the  basic 
decision  tree  specified  by  the  user.  The  other  alternatives  lead 
to  a chance  node  where  the  outcome  of  the  selected  observable  Is 
revealed. 

After  a chance  node  where  one  of  the  observables  Is  revealed, 
the  expanded  decision  tree  contains  a decision  node  where  the  alter- 
natives are:  to  learn  any  of  the  specified  set  of  observables  that 

has  not  been  learned  previously,  or  to  buy  no  further  information. 
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more  information 


FIGURE  2.24  SEQUENTIAL  INFORMATION  DECISION  TREE 
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Again,  the  last  alternative  leads  directly  to  the  basic  decision 
tree  specified  by  the  user,  except  that  this  tree  Is  now  conditioned 
on  the  knowledge  of  one  of  the  observables.  The  computer  program 
continues  to  generatu  the  expanded  decision  tree  In  this  form  until 
enough  decision  nodes  are  added  to  allow  the  decision  maker  to 
learn  any  subset  of  the  specified  observables  In  a:,y  order  before 
proceeding  to  the  primary  decision  problem. 

By  solving  the  decision  tree  In  Figure  2,24  several  times  using 
different  prices  for  each  of  the  observables.  It  Is  possible  for 
an  automated  decision  aid  to  map  out  decision  regions  such  as  those 
shown  In  Figure  2.25.  Figure  2.25  shows  decision  regions  that  might 
occur  for  two  observables. 

We  cannot  regnrd  the  value  of  learning  one  observable  by  Itself 
as  the  maximum  that  we  would  be  willing  to  pay  for  that  piece  of  In- 
formation. When  It  la  possible  to  buy  additional  Information  sequen- 
tially, the  value  of  an  observable  may  Increase.  To  determine  an 
upper  bound  for  realistic  programs  designed  to  gather  sequential 
Information,  we  need  a decision  aid  that  can  generate  and  solve  a 
decision  tree  like  the  one  In  Figure  2.24.  Without  this  sort  of  aid, 
the  problem  structuring  and  computations  are  sufficiently  difficult 
to  discourage  analysts  from  calculating  the  value  of  sequential  In- 
formation, even  when  :he  results  might  Influence  Informatlon-puchaslng 
decisions . 
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Figvure  2.25:  DECISION  REGIONS  FOR  SEQUENTIAL  INFORMATION 


2.2.5  The  Value  of  Flexibility 


The  notion  that  a good  decision  strategy  Is  a flexible  one  has 
long  been  Intuitively  appreciated  by  decision  makers.  Nearly  every- 
one lo  familiar  with  a story  of  a plan  that  went  wrong  because  It 
failed  to  adjust  for  some  unforeseen  circumstance.  Decision  analysis 
has  had  little  to  say  on  the  subject  of  flexibility.  However,  recent 
research  on  the  concept  ot  flexibility  shows  that  this  subject  should  be 
Incorporated  In  a decision  morphology. 

Houghly  speaking,  something  Is  flexible  If  It  may  be  easily 
varied.  However,  In  the  context  of  decision  making,  ease  of  varia- 
tion may  be  described  by  many  different  characteristics,  Our  point 
of  view  is  that  the  flexibility  of  a given  decision  variable  is 
determined  by  the  nature  of  the  choice  set  associated  with  that  var- 
iable. The  Itrger  the  choice  set,  the  greater  the  decision  flexi- 
bility. If  the  choice  set  consists  of  a single  point  element,  in 
other  words  if  the  decision  has  already  been  committed,  we  say  that 
the  decision  variable  is  inflexible, 

A number  of  the  classical  micro-economic  decision  problems 
for  which  flexibility  is  a concern  may  be  treated  within  this 
framework.  Merkhofer  {9]  has  shown  that  the  problem  of  sizing  a 
production  facility  can  be  so  analyzed.*  The  decision  strategy  of 
committing  something  less  than  one's  total  resources  so  as  to  be 
prepared  to  meet  unforeseen  opportunities  may  also  be  expressed 
as  a problem  of  maintaining  flexibility. 

* For  a discussion  of  this  problem  see  Marschak  and  Nelson  [8]  and 
Baumol  [1]. 
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The  value  of  flexibility  is  otrongly  dependent  upon  the  infor- 
mation that  might  be  receiveo  during  the  decision  process.  The  more 
a decision  maker  expects  to  learn  in  the  course  of  a decision,  the 
more  it  pays  to  follow  flexible  decision  strategies.  Similarly, 
the  more  flexible  one's  decisiou  strategy,  the  greater  the  value 
of  information  gathering.  Thus,  the  concepts  of  value  of  information 
and  value  of  flexibility  become  special  cases  of  the  more  general 
concept  of  the  value  of  information  given  flexibility. 

The  value  of  information  given  flexibility  measeres  the  value 
to  the  decision  maker,  in  economic  units,  of  obtaining  a given  amount 
of  Information  together  with  a given  amount  of  decision  flexibility. 

An  upper  limit  to  this  quantity  is  the  expected  value  of  perfect 
Information  given  perfect  flexibility,  EV’IGPF,  Figure  2.26  illus- 
trates the  calculation  of  the  EVPIGPF  in  a decision  tree, 

Figure  2. To.,  shows  a one  stage  decision  problem.  The  decision  maker  oust 

set  a number  of  decision  variables,  denoted  d^ d^.  Subsequently, 

the  outcomes  of  a number  of  random  variables,  s s , become 

known.  Once  he  has  made  his  decision  and  the  information  concerning 
the  random  variable  is  revealed,  the  decision  maker  does  not  have 
the  ability  to  go  back  and  alter  his  decision  settings.  The  struc- 
ture of  the  decision  tree  in  Figure  2.26a  implies  that  our  decision 
raa’cer  will  receive  no  information  prior  to  setting  his  decision 
variables. 

Figure  2.26b  illustrates  the  same  components  of  the  decision 
problem  with  perfect  Information  on  state  variable  s^  given  perfect 
flexibility  on  decision  variable  d^ . In  this  case  the  decision  maker 
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will  lean,  the  value  of  the  I’th  state  variable  before  he  must  set 
the  J th  decision  variable.  By  calculating  the  maximum  utility  of 
the  decision  problems  Illustrated  in  both  parts  of  Figure  2.26,  the 
value  of  the  Information  given  flexibility  can  be  obtained.  For 
an  expected  value  decision  maker,  the  EVPIGPF  will  be  the  difference 
between  the  expected  values  associated  with  the  two  decision  problems. 

Thus,  we  see  that  calculation  of  the  EVPIGPF  involves  the 
rearranging  of  decision  and  state  variable  nodes  in  the  problem's 
decision  tree.  Therefore,  the  calculation  of  the  value  of  flexibil- 
ity, like  the  calculation  of  the  value  of  information,  is  a tedious 
calculation . 

Assistance  in  the  form  of  a computerized  system  for  restruc- 
turing decision  trees  would  be  useful  for  information  and  flexibility 
computations.  With  such  an  aid,  the  analyst  would  specify  the  po- 
tential information  variables  and  those  decision  variables  that  could 
be  set  in  response  to  that  information.  Tree  restructuring  would 
then  be  performed  automatically  and  the  new  decision  structure  eval- 
uated. The  computed  output  would  be  the  expected  value  to  the 
decision  maker  of  obtaining  that  combination  of  information  and 
decision  flexibility.  This  value  would  be  extremely  useful  to  the 
decision  maker  for  evaluating  various  proposed  Information  gathering 
and  distribution  systems. 
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There  are  several  other  areas  where  further  research  is  needed 
to  understand  the  theoretical  properties  of  probabilistic  models  so 
that  thes^  properties  can  be  used  as  the  basis  for  efficient,  auto- 
mated decision  ald'^.  In  each  case  we  need  to  develop  ways  of  charac- 
terizing and  visualizing  the  important  elements  of  the  problei  in 
such  a way  that  they  can  be  expressed  in  a language  suitable  for 
automated  model  generation  and  analysis. 

Recent  research  into  Joint  time-risk  preference  has  demonstrated 
that  simplified  procedures  can  be  used  to  deal  with  complex  decision 
problems  involving  the  allocation  and  consumption  of  resources  over 
long  periods  of  time.  Automated  decision  aids  based  on  these  proce- 
dures may,  for  the  first  time,  make  it  practical  for  a decision 
analyst  to  construct  and  analyze  large  decision  models  incorporating 
complex  preferences  concerning  the  delay  of  c->nsumption  and  variation 
in  consumption  patterns. 

Another  area  where  recent  research  has  led  to  theoretical  deve- 
lopments that  may  prove  to  be  the  basis  of  new  automated  decision 
aids  is  the  analysis  of  competitive  decisions,  especially  when  the 
competition  takes  the  form  of  bargaining  or  negotiations.  There 
is  still  a long  way  to  go  before  research  on  competitive  decisions 
(game  theory,  social  choice  theory,  bargaining  theory)  can  form  the 
basis  of  practical  analytical  procedures.  However,  we  must  consider 
the  possibility  of  using  such  procedures  as  part  of  a decision 
morphology. 
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2. 3 ANALYSIS  OF  DECISION  MODELS 

Once  a decision  model  has  been  constructed  and  the  necessary 
quantitative  Inputs  (probabilities  and  values)  have  been  elicited, 
a number  of  different  analyses  can  be  performed  using  the  model  In 
order  to  gain  Insight  Into  the  decision  problem.  The  purpose  of  the 
following  sections  Is  to  discuss  at  a conceptual  level  the  various 
analytics]  procedures  that  can  be  applied  to  decision  models, 
without  dwelling  on  the  current  capability  of  computer  systems  to 
carry  out  the  analyses.  These  conceptual  tools,  together  with 
those  discussed  In  Section  2.2  (Theoretical  Properties  of  Probabilistic 
Models),  will  form  the  basis  of  computer  programs  that  analyze  decision 
models. 
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2-3.1  Sensitivity  Analysis 

One  of  the  basic  tools  of  present-day  decision  modeling  Is 
sensitivity  analysis.  By  determining  the  sensitivity  of  one  of  the 
model  parameters  to  changes  In  another  model  parameter,  we  can  gain 
some  Insight  Into  the  relative  Importance  of  various  components  of 
the  model.  However,  some  of  our  recent  research  has  shown  that 
sensitivities  may  be  a poor  guide  In  determining,  for  example,  the 
value  of  perfect  Information  about  an  uncertain  model  parameter. 
Furthermore,  we  currently  lack  adequate  procedures  for  calculating 
and  visualizing  joint  sensitivities:  the  sensitivity  of  one  model 

parameter  to  changes  In  several  of  the  other  model  parameters. 

There  are  a number  of  ways  to  measure  the  sensitivity  of  one 
parameter  to  another.  If  both  parameters  are  known  with  certainty, 
then  we  can  use  a deterministic  sensitivity  analysis.  The  most 
comn.on  way  to  carry  out  this  form  of  analysis  is  to  vary  one  of  the 
parameters  over  a specified  range,  and  plot  the  corresponding  values 
of  the  second  parameter  as  a function  of  the  first  parameter.  The 
resulting  graph,  showing  the  pairs  of  parameter  values  that  fit  the 
model,  describes  the  global  sensitivity  of  the  parameters  to  each  other. 
The  analysis  Is  global  In  the  sense  that  the  relationship  between  the 
two  parameters  Is  described  over  a given  range.  On  the  other  hand, 
we  could  compute  the  local  sensitivity  of  one  parameter  to  another,  at 
a given  operating  point,  by  determining  the  rate  at  which  small  changes 
in  one  parameter  cause  the  other  parameter  to  change.  Local  sensitiv- 
ities are  measured  In  terms  of  partial  derivatives. 

Another  way  to  classify  sensitivity  analyses  Is  by  whether  they 
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Further  research  is  needed  to  dstennlne  the  proper  use  of 
sensitivity  analysis  in  the  construction  and  analysis  of  decision 
models.  While  sensitivity  analyses  have  a strong  intuitive  appeal, 
they  can  supply  at  best  a rough  idea  of  the  Implications  of  various 
decision  models.  We  need  a better  understanding  of  the  linkages 
between  sensitivity  analyses  and  other  analytical  measures  such  as  the 
value  of  information  and  flexibility,  and  we  need  better  guidelines 

for  when  it  is  appropriate  to  apply  the  various  forms  of  sensitivity 
analyses. 

2. 3.  2 Analysis  of  Decision  Trees 

Decision  trees  are  one  of  the  fundamental  tools  of  decision 
analysis.  However,  a characteristic  of  decision  trees  is  that  they 
tend  to  grow  very  rapidly  as  the  sire  of  the  model  is  expanded.  At 
present  it  is  not  uncommon  for  decision  analysts  to  utilize  decision 
trees  containing  thousands,  or  even  millions,  of  nodes.  An  analyst 
often  finds  that  straightforward  procedures  for  visualizing,  modifying 
and  analyzing  small  decision  trees  become  far  too  time  consuming  when 
the  size  of  the  tree  grows,  even  when  automated  decision  aids  are 
available. 

To  visualize  a large  decision  tree,  the  analyst  must  often  think 
in  terms  of  simplified  representations  of  the  tree.  The  analyst 
constructs  the  decision  tree  by  first  building  the  simplified  represen- 
tation, and  then  using  it  to  generate  the  entire  tree  structure.  (See 
the  discussion  in  Section  2.1.1  Algebraic  and  Graphical  Languages  for 
Decision  Models.)  Once  the  entire  decision  tree  has  been  generated, 
the  analyst  may  wish  to  check  his  logic  by  looking  at  various  portions 
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of  the  decision  tree.  To  do  this  he  needs  a procedure  for  rapidly 
selecting  a particular  location  in  the  decision  tree  and  then  looking 
at  the  tree  structure  surrounding  that  location,  preferably  presented 
in  graphical  form.  He  may  also  wish  to  "fly  over"  the  decision  tree 
following  a particular  path  through  the  decision  tree  or  moving 
accross  the  decision  tree  to  investigate  similar  nodes. 

During  this  process  the  .in^.yst  may  find  an  Incorrect  portion 
of  the  decision  tree  indicating  that  the  logic  he  used  to  construct 
the  tree  was  faulty.  At  this  point  he  might  want  to  make  a local  change 
in  the  full-scale  decision  tree.  However,  since  an  error  in  on(  part 
of  a large  decision  tree  is  often  symptomatic  of  similar  errors  else- 
where in  the  tree,  it  would  probably  be  better  for  the  analyst  to 
return  to  his  simplified  representation  of  the  decision  tree  and 
correct  the  error  at  that  level.  Once  the  error  has  been  corrected 
in  the  simplified  version  of  the  decision  tree,  the  entire  decision 
tree  can  be  regenerated  and  the  analyst  can  check  to  see  that  his 
changes  have  produced  the  desired  results. 

A capability  that  will  undoubtedly  be  needed  in  future  decision 
aiding  systems  is  automatic  processing  of  probabilities  within  a 
decision  tree  using  Bayes'  rule.  This  form  of  decision-tree  proces- 
sing can  be  Implemented  through  the  use  of  two  decision  trees  for  the 
same  problem:  one  decision  tree  showing  the  sequence  of  events  and 

decisions  faced  by  the  decision  maker,  and  another  decision  tree 
(sometimes  called  a probability  assessment  tree)  that  specifies  the 
same  events  and  decisions  in  the  order  in  which  it  is  easiest  to 
assess  the  necessary  probabilities. 

If  the  decision  problem  is  complex,  each  of  these  decision  trees 
might  be  accompanied  by  an  appropriate  simplified  representation.  In 
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addition  to  the  procedures  needed  to  translate  from  each  simplified 
representation  to  the  corresponding  decision  tree,  general  procedures 
based  on  Bayes'  rule  will  be  needed  to  translate  from  the  probability 
assessment  tree  to  the  decision  tree  that  specifies  the  sequence  of 
decisions  and  events. 

As  the  discussion  In  Section  2.2.3,  The  Value  of  Decision  Deiendent 
Clairvoyance,  has  Indicated,  It  Is  difficult  to  apply  Bayes'  rule 
without  carefully  considering  the  structure  of  the  decision  problem. 
However,  by  Including  these  considerations  as  part  of  an  automatic 
system  for  Bayes'  rule  processing.  It  should  be  possible  for  an 
analyst  to  deal  directly  with  a problem  In  the  form  In  which  It  Is 
easiest  to  assess  probabilities  (the  probability  assessment  tree)  and 
then  translate  automatically  to  a decision  tree  that  specifies  the 
events  and  decisions  In  the  order  In  which  they  occur. 

There  are  often  several  different  ways  to  compute  a particular 
result  using  a decision  tree.  For  example,  to  determine  the  profit 
lottery  associated  with  a decision  tree,  it  Is  possible  to  work 
forward  through  the  tree  until  every  possible  outcome  has  been  deter- 
mined together  with  Its  associated  probability.  Alternatively,  It 
Is  possible  to  work  backwards  through  a declslot  ree  determining  the 
profit  lottery  at  each  node  In  the  tree  until  the  profit  lottery  at  the 
beginning  of  the  tree  has  been  determined.  The  structure  of  the  tree, 
especially  the  amount  of  coalescence,  determines  the  most  efficient 
solution  technique.  It  would  be  desirable  for  automated  decision  aids 
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to  contain  several  different  solution  techniques  together  with 
algorithms  for  testing  the  structure  of  a decision  tree  and  deter- 
mining the  most  efficient  analytical  techniques. 

2.3.3  Approximate  Methods  of  Probabllllstlc  Processln 


The  purpose  of  this  section  Is  to  explain  how  approximate  me;:hods 
can  be  used  to  determine  the  value  of  Information  and  manage  the  growth 
of  models.  The  need  for  model  management  to  curtail  exponential  growth 
of  model  size  Is  discussed  In  the  Section  2.1.3.  The  approximate  value 
of  Information  calculations  are  based  on  deterministic  sensitivities, 
and  decisions  to  Increase  or  decrease  the  size  of  a model  are  based  on 
th  approximate  values  of  Information. 

'•y 


Decision  problems  may  be  grouped  according  to  the  number  of 
stages  they  contain.  We  define  a half-stage  problem  as  one  without 
decision  variables.  A single  stage  Is  any  number  of  decision  variables 
followed  by  any  number  of  state  variables.  Multistage  problems  are 
characterized  by  decision  variables  separated  by  state  variables.  Flgur 
2.27  classifies  typical  problems.  Any  decision  problem  can  be  solved 
to  any  desired  accur  <'y  using  trees;  however.  In  many  problems  certain 
"smoothness"  properties  can  be  exploited  to  find  answers  as  accurate 
as  those  from  trees  at  a fraction  of  the  computational  cost.  For  one- 
half  or  one  stage  problems  specific  procedures  can  be  programmed  that 
are  adequate  for  the  majority  of  problems.  Two  stage  p.ocedures  exist 
for  a class  of  problems.  Practical  procedures  do  not  ex^st  for  many 
stage  problems. 


'iTure  2.27:  CLASilFICATICN  OF  DECISION  PROBLEMS 
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For  simplicity  we  will  treat  the  case  of  risk  indifference  in 
this  section.  However.  T.  Rice  [10]  has  shown  that  only  minor  modi- 
fications are  required  to  extend  the  framework  to  Include  risk 
aversion. 

A value  function,  also  known  as  a deterministic  model  or  a 
profit  function,  can  be  expanded  in  a Taylor  series  about  the  mean 
of  the  state  variables  and  the  deterministic  optimum  setting  of  the 
decision  variables.  This  approach  is  exact  for  a single  stage  problem 
that  Is  quadratic  In  continuous  state  and  decision  variables  and  for 
discrete  decision  problems  where  the  value  function  Is  a linear 
function  of  the  state  variables. 

R.  Howard  has  developed  and  documented  this  approach  for  change 
of  variable  problems  In  his  course  notes  for  EES  221  [4b] at  Stanford 
University  and  for  one  stage  problems  in  his  paper  Proximal  Decision 
Analysis  [4c].  His  results  are  algebraic  expressions  for  the  mean  and 
variance  of  the  profit  lottery  and  for  the  value  of  clairvoyance  on 
the  state  variables.  Means,  variances,  and  covariances  for  the  state 
variables,  as  well  as  the  partial  derivations  of  the  profit  with 
respect  to  the  state  and  decision  variables  are  required  inputs.  To 
automate  Howard's  methodology,  the  computer  would  be  given  the  value 
or  profit  function  and  the  moments  of  the  state  variables.  Then  the 
computer  would  automatically  run  sensitivities  to  estimate  the 
required  partial  derivatives. 

Rice  has  generalized  Howard's  approach.  The  general  approach 
also  starts  with  sensitivities  and  ends  with  the  value  of  clairvoyance 
on  each  state  variable.  However,  the  middle  step  is  eliminated,  going 
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directly  from  sensitivities  to  value  of  clairvoyance  without  evalu- 
ating partial  derivatives.  For  continuous  problems,  ones  with  con- 
tinuous state  and  decision  variables,  the  two  methods  are  equivalent. 
The  advantage  of  the  direct  method  Is  that  It  also  works  for  problems 
with  discrete  dei  Ision  and/or  state  variables  and  with  discontinuous 
value  functions. 

Computerizina  the  Single  Stage  Model 

For  a computer  to  find  the  value  of  clairvoyance  for  a state 
variable  given  only  a single  stage  profit  function  and  the  moments 
(or  distributions)  of  the  state  variables,  two  conditions  must  hold: 

(I)  The  state  variables  must  be  probabilistically  Independent 
of  the  decision  variables. 

(II)  The  value  structure  must  be  of  the  form  v(s,d):  a deter- 

ministic model  which  assigns  a single  profit  measure  to  each 
complete  vector  of  state  and  decision  variables. 

Neither  condition  Is  restrictive.  The  Entrepreneur's  Problem  In  Prox- 
imal Decision  Analysis  [4c]  demonstrates  how  apparent  violations  of 
(1)  can  be, rectified  by  reformulating  the  deterministic  model.  The 
model  form  v(s,d)  in  (11)  is  common  to  many  discrete  as  well  as  con- 
tinuous problems. 

The  basis  for  the  computer  program  Is  the  approximate  value  of 

Information.  The  expected  value  of  clairvoyance  on  the  I'th  state 

variable  Is  the  prior  expectation  of  the  conditional  expected  value 

given  s^  less  the  prior  expected  value; 

<v  I £>=  «v|s  , ( > |(>  - <vU> 

1 ^ 

Alternatively,  we  can  focus  on  changes  of  decision  by  subtracting 
the  prior  expected  value  from  the  conditional  expc-ted  value  before 
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taking  the  second  expectation: 


<^c^  k>  -«  vlsi,^>  - <vj^  > |^> 

v;  '"“I'"®  clairvoyance  Is  the  expected  Increase  In  value  from 

making  decisions  after  s^  Is  revealed  rather  than  before.  We  define 
the  quantity: 

u <vls^,^>  -<vk> 

as  the  stochastic  compensation,  stochastic  because  each  term  Is  an 
expected  value  and  compensation  because  the  decision  Is  reoptimized  to 
compensate  for  the  departure  of  the  I'th  state  variable  from  Its  mean. 
Using  the  new  terminology,  the  value  of  clairvoyance  on  the  I’th  state 
variable  Is  the  expected  stochastic  compensation. 

^ To  approximate  the  value  of  clairvoyance  deterministic  compen- 

sation may  be  substituted  for  stochastic  compensation. 

Steps  to  Compute  the  Approxvnate  Value  of  Infoimation 

To  calculate  the  approximate  value  of  Information  for  the  single 
stage  problem,  a computer  must  complete  the  following  steps: 

1)  Accept  the  problem  specification 
<-  2)  Solve  for  the  deterministic  optimum  decision 

Perform  deterministic  open  loop  sensitivities 
4)  Perform  deterministic  closed  loop  sensitivities 
C)  5)  Generate  compensation  functions 

6)  Compute  the  expected  compensation 

The  procedure  Is  remarkably  robust.  It  works  regardless  of  whether 
Q the  state  and  decision  variables  are  continuous  or  discrete.  - However, 
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because  of  differences  In  optimization  techniques  the  algorithms  to 
achieve  stept  1-6  are  different  for  discrete  and  continuous  decision 
variables. 

Diaarete  Decision  Vcopicible 

For  a discrete  decision  variable  steps  2-4  can  be  performed 
simultaneously.  As  Illustrated  In  Figure  2.28  for  two  decision  alter- 
natives, the  value  v must  be  computed  for  each  alternative  at  s,  and 
at  s + As.  Then  the  open  loop  sensitivity  is  the  curve  with  the 
highest  value  at  s,  the  one  for  dj^.  In  the  example.  The  closed  loop 
sensitivity  is  the  upper  boundary  of  the  curves.  In  Figure  2.28  it  is 
tbe  dj^  open  loop  sensitivity  to  the  right  of  the  crossover  point  and 
the  d2  open  loop  sensitivity  to  the  left  of  the  crossover  point.  The 
compensation  Is  the  difference  between  the  closed  and  open  loop  sen- 
sitivities, plotted  In  Figure  2.29  for  the  example.  The  expected  value 
of  clairvoyance  Is  found  by  numerically  integrating  the  product  of  the 
compensation  plot  and  the  distribution  on  the  state  variable. 

The  extension  of  the  procedure  to  many  discrete  alternatives  is 
straightforward.  There  Is  one  open  loop  sensitivity  for  each  alter- 
native. The  closed  loop  sensitivity  Is  the  concave  envelope  of  the 
open  loop  sensitivities.  The  compensation  is  the  difference  between 
the  closed  and  open  loop  sensitivities  as  before. 

! t*.  ! V*  1 1*1  *il  • f t'n 

For  continuous  decision  variables  or  for  discrete  decision  varia- 
bles with  many  alternatives,  the  computer  will  generate  conventional 
sensitivities.  Starting  with  the  base  case  where  all  state  variables 
are  set  to  their  means  and  all  decision  variables  are  set  at  the 
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FIGURE  2.29  COMPENSATION  FOR  A DISCRETE  DECISION  VARIABLE 
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deterministic  optimumj  the  computer  successively  adds  and  subtracts  an 
increment  to  the  i'th  state  variable.  As  Illustrated  in  Figure  2.30a, 
the  decision  is  reoptimi^ed  at  each  point  for  the  closed  loop  sensi- 
tivity and  held  at  the  deterministic  optimum  for  the  open  loop  sensi- 
tivity. The  compensation  plotted  in  Figure  2.30b  is  the  difference 
between  the  open  and  closed  loop  sensltlvltes.  To  compute  the  expected 
compensation  the  computer  will  approximate  the  compensation  with  a 
quadratic  or  other  curve  form  and  perform  numerical  integration. 

21)0  Stage  Problems 

Merkhofer  [9]  has  shown  that  under  certain  conditions  the  two 
stage  continuous  decision  problem  Illustrated  in  Figure  2.31  is 
solvable  by  these  methods.  As  discussed  in  The  Economics  of  Decision 
[10]  t the  only  Important  terms  in  the  value  function  are  the  G 
matrix  of  second  partial  derivatives  of  value  with  respect  to  the  i'th 
state  variable  and  the  j'th  decision  variable  and  the  H matrix  of 
second  partial  derivations  of  value  with  respect  to  decision  variable 
1 and  decision  variable  j.  These  matrices  may  be  positioned  as  shown 
in  Figure  2.31.  The  value  of  compensation  for  this  model  is  defined 
to  be  the  difference  between  the  open  loop  sensitivity  of  the  value 
function  to  the  state  variables  and  the  partially  closed  loop 
sensitivity  in  which  the  decision  variables  are  held  at  their 
deterministic  optimums  but  the  decision  variables  continuously 

optimized  as  is  varied.  The  expected  deterministic  compensation  is 
calculated  to  be: 


<v 

comp 


1^  > = 


<s'  G H 
-I  -12  22  12-^1 
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2.  G22  is  a zero  matrix  and  S2|s^,  e\|e,=  0.  (Non-observable 

/ 

state  variables  are  deterministically  Independent  of  the 
flexible  decision  variables  and  the  prior  expectation  Is 
that  the  posterior  mean  of  will  not  be  shifted  by  knowledge 
of  Sj^.) 

These  conditions  are  frequently  satisfied  In  practice. 
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2.4  ELICITATION  OF  SUBJECTIVE  INFORMATION 

Automated  decision  aids  have  a potentially  useful  role  in  the 
elicitation  of  subjective  information.  However,  the  aids  that  have 
been  developed  to  date  in  this  area  have  been  rudimentary  at  best. 

The  primary  limitation  of  current  aids  is  that  they  are  de- 
signed to  take  a probabilistic  "snapshot"  of  a well  defined  variable. 
They  record  probabilities  and  values  without  being  sensitive  to 
biases,  conditionality,  and  shifts  in  the  subject »s  opinion.  Conse- 
quently they  never  recommend  additional  training  to  overcome  biases, 
or  additional  structuring  or  modeling  to  allow  conditioning  on 
previously  unstated  variables,  or  additional  encoding  to  replace  data 
where  the  subject  has  simply  changed  his  mind. 

Although  automated  systems  may  eventually  displace  the  human 
Interviewer,  initial  work  in  this  area  will  probably  be  to 
develop  computerized  aids  to  make  the  human  interviewer  more  ef- 
fective and  efficient. 

A second  problem  with  current  techniques  is  that  they  are  in- 
sensitive to  the  reason  the  variable  is  being  encoded.  Presumably, 
within  the  context  of  a given  analysis  accuracy  is  more  Important 
for  some  variables  than  for  others.  The  order  of  encoding  and  re- 
sulting conditionalities  may  affect  the  value  of  information  cal- 
culations that  can  be  performed  in  an  analysis.  In  other  words, 
the  natural  order  of  developing  a model  and  then  encoding  the 
necessary  probabilities  applies  to  the  development  of  automated 
aids  as  well  as  to  the  execution  of  a decision  analysis  project. 
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t As  a result  we  have  spent  most  of  our  effort  during  the  first 

part  of  this  research  project  In  areas  other  than  elicitation. 

The  following  subsections  contain  some  preliminary  thoughts  on 
the  process  of  encoding  subjective  Information.  We  Intend  to 
expand  these  Ideas  during  the  latter  half  of  the  current  research 
effort. 

« 2.4.1  Probability  Encoding 

The  process  of  probability  encoding  has  been  the  subject  of 
considerable  research,  but  very  little  of  this  effort  has  been 
i directed  toward  the  development  of  automated  probability-encoding 

I 

aids.  At  the  present  time  almost  all  probability  encoding  takes 
the  form  of  an  Interview  or  discussion  between  an  analyst  and  one 
or  more  Individuals  who  supply  the  necessary  Information.  The 
analyst  may  have  the  assistance  of  other  Individuals  during  the 
encoding  process,  and  he  may  use  some  very  simple  visual  aids 
to  help  the  subjects  conceptualize  their  probability  estimates. 

However,  with  the  exception  of  a few  unsophisticated  computer 
programs,  automated  decision  aids  for  probability  encoding  are 
not  available  for  either  the  analyst  or  the  Individuals  supplying 
the  estimates. 

One  question  for  which  we  do  not  currently  have  a satisfactory 
answer  Is  whether  the  analyst  can  be  completely  replaced  by  an 
automated  decision  aid  during  the  encoding  process.  Regardless 
of  how  sophisticated  the  aid  may  be.  It  will  not  have  all  of  the 
Information  available  to  an  analyst.  Both  an  analyst  and  a de- 
cision aid  will  have  numerical  Information  supplied  by  the  sub- 
ject, but  only  an  analyst  will  be  able  to  detect  the  visual  and 
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emotional  cues  that  indicate  that  the  subject  is  becoming  uneasy 
or  confused  during  the  encoding  process.  The  question  of  whether 
decision  aids  should  be  designed  to  replace  the  decision  analyst's 
role  In  probability  encoding  or  simply  assist  an  analyst  with 
this  task  will  probably  not  be  resolved  until  we  have  Implemented 
various  automated  probability  encoding  aids  and  have  gained  some 
®*P®^^^®nce  with  their  use.  We  may  find  that  the  analyst's  role  In 
probability  encoding  can  be  performed  by  an  automated  decision  aid 
after  the  subject  has  had  enough  training  to  avoid  some  of  the 
basic  problems  associated  with  quantifying  subjective  Information. 
However,  an  analyst  may  be  required  the  first  few  times  that  a 
subject  Is  faced  with  the  encoding  process. 

There  Is  always  a choice  between  encoding  the  uncertainty  In 
an  important  variable  and  modeling  the  problem  further.  At  one 
extreme,  It  Is  conceivable  that  the  final  outcome  of  a project 
could  be  encoded  directly,  thus  bypassing  the  need  for  examining 
the  underlying  variables  of  the  problem.  Generally,  however,  the 
distribution  for  the  final  outcome  Is  more  easily  reached,  and 
provides  more  confidence.  If  a model  Is  constructed  that  relates 
the  final  outcome  to  other  variables.  The  modeling  effort  tends 
to  be  most  effective  and  economical  If  It  starts  with  a simplified 
model  that  is  successively  refined.  At  some  point  during  this 
process  the  model  will  become  sufficiently  complex  to  shift  the 
balance  between  modeling  and  encoding.  At  this  point  the  difficulties 
associated  with  expanding  the  model  further  outweigh  the  simplifi- 
cations of  the  encoding  process  that  would  result  from  such  an 
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expansion.  In  the  discussion  that  follows  it  will  be  assumed  that 
the  trade—off  between  modeling  and  encoding  has  already  been  con- 
sidered and  the  decision  has  been  made  to  encode  the  pecessary  in- 
formation. 

Individual  Probilitu  Enaodin/j 

The  majority  of  the  research  to  date  on  probability  encoding 
has  dealt  with  the  question  of  eliciting  information  from  an  indi- 
vidual Subject.  This  form  of  encoding  must  overcome  the  cogni- 
tive and  motlvtitlonal  biases  that  distort  the  subjective  information 
supplied  by  an  individual.  Cognitive  biases  are  a systematic  dis- 
tortion of  an  individual's  subjective  estimates  caused  by  the  way 
he  thinks  about  uncertainty.  For  example,  a response  may  be 
biased  toward  the  most  recent  pieco  of  information  simply  because 
that  information  is  easiest  to  recall.  Motivational  biases  are 
distortions  in  an  individual's  subjective  judgment  caused  by  his 
perceived  system  of  personal  reward  for  various  responses.  For 
example,  an  individual  may  want  to  bias  his  response  because  he 
perceives  that  his  subsequent  performance  will  be  evaluated  by  a 
comparison  of  his  response  to  the  actual  outcome. 

Techniques  for  eliciting  information  may  be  classified  accord- 
ing to  the  type  of  questions  asked.  Probability  methods  require  the 
subject  to  assess  the  probability  associated  with  a particular  out- 
come of  a state  variable.  Value  methods  require  the  subject  to 
assign  the  outcomf.  which  corresponds  to  a particular  piobabillty. 
Mixed  probability-value  methods  require  the  subject  to  assess 
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values  on  both  the  outcome  and  probability  scales;  the  subject 
essentially  describes  points  on  the  cumulative  distribution  of 
an  uncertain  quantity.  These  encoding  methods  can  be  used  in 
either  a direct  or  an  indirect  response  mode.  In  the  direct 
mode,  the  subject  is  asked  questions  that  require  numbers  as 
answers.  The  answers  can  be  given  in  the  form  of  probabilities 
(or  equivalently  in  the  form  of  odds)  or  values.  In  the  indirect 
response  mode,  the  subject  is  asked  to  choose  between  two  or 
more  uncertain  lotteries.  The  lotteries  are  adjusted  until  he 
is  indifferent,  and  the  point  at  which  he  is  indifferent  is  trans~ 
lated  into  a probability  or  value  assignment.  The  indirect  re- 
sponse mode  is  typically  used  with  a reference  process,  where  the 
subject  is  asked  to  compare  some  aspect  of  an  uncertain  quantity 
to  a reference  process  such  as  the  toss  of  a fdir  coin  or  the  spin 
of  a wheel  of  fortune. 

The  most  appropriate  encoding  method  depends  on  the  type  of 
uncertainty  being  assessed.  If  there  are  only  a few  possible  out- 
comes for  an  uncertain  quantity,  a method  that  requires  the  sub- 
ject to  divide  up  the  range  of  possible  outcomes  into  a 'number  of 
intervals  may  not  be  appropriate.  An  automated  decision  aid  should 
be  capable  of  using  any  one  of  several  encoding  methods  to  elicit 
subjective  information,  Itb  choice  of  a particular  encoding  method 
should  be  based  on  the  characteristics  of  the  uncertain  quantity, 
its  Importance  to  the  modeling  effort,  and  the  personal  preferences 
of  the  subject  supplying  the  inforuation. 
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i f encoding  process  consists  of  five  distinct  phases:  the 

motivational  phase,  structuring  phase,  conditioning  phase,  encoding 
phase,  and  the  verification  phase.  Each  may  require  different  types  ^ 

of  decision  aids.  In  the  motivational  phase.  It  Is  necessary  to 
explore  the  subject's  motivational  biases  and  attempt  to  eliminate 
or  compensate  for  them.  In  the  structuring  or  definition  phase, 

■>  subject  and  analyst  (or  decision  aid)  must  reach  an  agreement 

on  the  exact  definition  of  the  uncertain  quantity  being  considered. 

The  conditioning  phase  Is  directed  toward  finding  out  how  the  sub- 

8°®®  about  making  his  probability  assignments  and  heading  off 
any  biases  that  might  surface  during  the  encoding  process.  Once 
the  uncertainty  has  been  well  defined  and  the  subject's  cognitive 
and  motivational  biases  have  been  explored,  the  process  enters  the 
encoding  phase  and  utilizes  one  of  the  encoding  methods  discussed 
above.  In  the  verification  phase  the  encoded  Information  Is 
subjected  to  a number  of  consistency  checks  to  see  If  It  truly 
represents  the  subject's  beliefs. 

There  Is  little  value  In  designing  a decision  aid  that  simply 
asks  the  subject  for  probability  estimates.  To  do  an  adequate  Job 
of  probability  encoding  the  decision  aid  must  be  capable  of  working 
Interactively  with  the  subject  to  understand  how  he  goes  about 
making  his  probability  assignments.  This  Information  can  then  be 
used  by  the  decision  aid  to  either  train  the  subject  to  overcome 
the  various  biases  that  can  distort  his  subjective  estimates,  or 
to  devise  means  for  compensating  for  the  biases. 
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Encodiitg  PpobabHietia  Dependenciee 

Although  considerable  research  has  been  devoted  to  the  ques- 
tion of  encoding  probabilities,  very  little  work  has  been  done  on 
the  question  of  encoding  probabilistic  dependencies.  Decision 
analysts  have  recognized  that  the  degree  of  difficulty  associated 
with  the  encoding  process  is  greatly  increased  when  the  probabilities 
being  encoded  depend  on  other  random  variables  or  decisions. 

For  example,  consider  a model  in  which  there  are  four  random 
variables  each  of  which  has  three  possible  outcomes.  If  the  ran- 
dom variables  are  all  independent  we  can  specify  the  uncertainty 
in  the  model  with  12  probabilities.  On  the  other  hand,  if  the 
four  random  variables  are  all  dependent,  it  will  be  necessary 
to  assess  a minimum  of  81  probabilities. 

In  large  probability  models,  the  number  of  probability  as- 
sessments required  to  specify  the  model  can  grow  exponentially  with 
the  number  of  random  variables  in  the  model.  Therefore,  un- 
less steps  are  taken  to  overcome  the  difficulties  associated  with 
encoding  probabilistic  depende’icles,  the  number  of  probability 
assessments  required  can  become  prohibitively  large.  (Section  2.2.1, 
Probabilistic  Dependence,  and  Section  2.4.2,  Coalescence,  discuss 
some  of  the  conceptual  tools  that  have  been  developed  for  describing 
and  limiting  probabilistic  dependencies.) 

In  some  situations  it  is  easiest  for  a subject  to  assess  the 
uncertainties  associated  with  dependent  random  variables  as  joint 
probabilities,  while  in  other  situations  the  subject  may  find  it 
easier  to  assess  the  same  information  in  terms  of  conditional  prob- 


134 


abilities.  A joint  probability  distribution  specifies  the 
probability  of  occurrence  of  each  possible  combination  of  values 
of  the  random  variables.  Conditional  probability  distributions 
specify  the  probability  that  some  subset  of  the  dependent  random 
variables  have  certain  values  given  the  values  of  the  remaining 
random  variables.  In  the  example  with  four  random  variables,  each 
of  which  has  three  possible  outcomes,  there  are  81  joint  probabil- 
ities, one  for  every  combination  of  outcomes.  In  the  same  example, 
there  are  many  possible  conditional  probabilities,  of  which  120 
(3+3  +3  + 3 ) would  be  required  to  specify  all  of  the  uncer- 

tainties in  the  problem.  In  this  example,  the  number  of  conditional 
probabilities  needed  to  specify  the  uncertainty  exceeds  the  number 
of  joint  probabilities.  However,  in  many  large  decision  models 
containing  some  form  of  Independence  among  the  random  variables, 
the  number  of  assessed  probabilities  can  be  minimized  by  eliciting 
conditional  rather  than  joint  probabilities. 

It  is  often  difficult  to  conceptualize  the  probabilities  as- 
sociated with  dependent  random  variables,  especially  when  the  ran- 
dom variables  represent  sequences  of  events  that  can  occur  in  any 
order.  Subjects  usually  think  of  sequences  of  events  in  terms  of 
conditional  probabilities,  but  when  the  order  in  which  the  events 
occur  is  not  specified,  it  is  not  clear  how  the  subject  should  as- 
sess the  conditional  probabilities. 

Another  problem  with  assessing  conditional  probabilities  is 
th?.;  the  subject  may  anchor  on  his  probability  estimate  given  one 
set  of  conditioning  events,  and  then  shift  his  probability  estimates 
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by  an  Insufficient  amount  when  the  condition  events  are  changed. 
Before  automated  aids  can  be  developed  In  this  area,  further  research 
Is  needed  to  expand  our  understanding  of  these  problems. 

Encoding  Hare  Events 

Encoding  the  probability  of  rare  events— events  which  have  a 
very  small  probability  of  occurring— is  difficult  for  two  reasons. 

The  subject  is  being  asked  to  assess  the  probability  or  odds  of  an 
event  with  which  he  has.  by  definition,  little  experience. 

In  addition,  the  subject  may  have  to  distinguish  among  very  small 
probabilities  or  odds  (for  example,  a probability  of  one  in  one 
thousand  as  compared  to  a probability  of  one  in  ten  thousand) . 

Procedures  have  been  proposed  for  overcoming  these  difficulties. 
One  such  procedure  is  to  relate  the  rare  event  to  ocher  uncertain 
events  with  which  the  subject  is  more  familiar,  and  to  describe  the 
2vent  in  <.erms  of  its  component  parts  or  as  the  result  of  a sequence 
of  other  events.  The  purpose  of  this  procedure  is  threefold:  to 
gather  together  all  of  the  information  rt levant  to  the  event  which 
may  be  within  the  subject's  command,  to  see  if  the  event  can  be  re- 
defined in  terms  which  no  longer  involve  small  probabilities,  and 
to  produce  lists  of  related  events  that  can  be  used  as  reference 

points  in  getting  the  subject  to  make  relative  statements  about 
their  uncertainty. 

The  subject  is  then  asked  to  make  relative  judgments  about  the 
occurrence  of  a number  of  different  events  before  dealing  with  very 
snail  probability  numbers.  Subjects  can  often  say  whether  the 
probability  of  one  rare  event  is  greater  or  less  than  the  probability 


of  another  rare  event,  even  though  they  would  find  it  difficult 
to  assign  a numerical  value  to  either  probability.  By  doing  so  the 
subject  can  bound  the  probability  associated  with  the  rare  event 
and  then  narrow  the  bound  as  needed  for  the  modeling  effort. 

Since  subjects  often  have  difficulty  thinking  about  tne  prob- 
abilities or  odds  associated  with  rare  events,  decision  aids 
might  be  used  to  help  them  visualize  the  problem.  A decision  aid 
could  be  used  to  generate  a reference  event  a^Ainst  which  the  un- 
known probility  could  be  compared.  For  example,  one  chance  in 
ten  thousani  could  be  visualized  in  terms  of  a grid  lispiayed  on 
a computer  screen  with  one  hundred  divisions  on  each  side.  The 
subject  could  be  asked  to  compare  the  probability  of  the  rare 
event  with  the  probability  that  he  could  correctly  pick  a square 
from  the  grid  that  someone  else  had  chosen  without  his  knowledge. 
Decision  aids  could  also  be  used  to  show  the  r* ^aticnship  between 
a rare  event  tnd  other  related  events  that  might  lead  to  its  occur- 
rence. Howe'-  fore  we  can  begin  to  design  decision  aids  for 

encoding  ture  events,  we  neeo  a much  better  understanding  of  the 
process  used  by  individuals  to  conceptualize  and  e- , ress  snail 
probabilities  or  odds. 

Group  Enaodinq 

Another  area  of  probability  encoding  about  which  we  need  a 
better  understanding  before  designing  decision  aids  is  group  en- 
coding. Group  encoding  refers  to  tha  process  by  which  the  judgment 
of  a group  of  people  is  quantified.  There  are  many  decision  problems 
for  which  more  than  one  expert  is  available  to  supply  subjective 
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estimates  of  uncertain  quantities,  and  there  can  be  considerable 
differences  of  opinion  among  the  various  experts.  Group  encoding 
procedures  are  used  to  aggregate  the  estimates  of  several  experts 
into  one  probability  distribution  that  can  be  used  as  the  input  to 
a decision  analysis. 

Group  encoding  is  currently  carried  out  with  a group  of  sub- 
jects, whose  Judgments  may  have  been  individually  encoded  prior 
to  the  group  encoding  session,  and  an  analyst  vbo  monitors  the 
flow  of  information  among  the  subject,  to  see  that  all  the  rele- 
vant opinions  on  the  subject  are  disc  tssed  and  incorporated 
into  the  group  consensus.  Another  individual  may  have  the  respon- 
sibility to  review  the  group  consensus  and  dissenting  opinions, 
and  decide  on  the  final  probability  distribution  that  should  be 
used  in  the  analysis.  This  individual  is  typically  the  head  of 
the  organization  that  has  employed  the  services  of  the  group  of 
experts . 

Much  of  the  research  associated  with  group  probability  encoding 
has  been  concerned  with  the  way  in  which  information  should  be  ex- 
changed among  the  Individuals  supplying  the  subjective  estimates. 

At  one  extreme,  it  has  been  suggested  that  the  participants  in  the 
group  encoding  process  remain  anonymous,  and  that  they  send  each 
other  their  subjective  estimates  but  not  the  logic  behind  the 
estimates.  This  procedure  has  been  called  the  Delphi  technique; 
it  is  designed  to  reduce  the  Influence  of  group  members  with 
dominating  personalities  and  encourage  each  menber  of  the  group 
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to  reach  his  own  opinion.  AJLterni.’tive  procedures  allow  the  par- 


ticipants to  meet  face-to-face  and/or  exchange  Information  freely 


on  an  unlimited  basis. 


Automated  decision  aids  are  potentially  very  valuable  for 


group  encoding  since  they  can  act  as  a communication  medium, 


as  well  as  an  elicitation  device.  If  It  Is  desirable  for  the 


subjects  to  remain  anonymous,  then  an  automated  aid  could  be  used 


to  elicit  the  necesaary  Information  from  each  Individual,  and 


then  rapidly  aggregate  and  present  the  Information  to  everyone  In 


the  group.  The  format  of  the  group  encoding  process  could  be 


much  more  controlled  If  the  communication  environment  were  an 


automated  decision  aid  Instead  of  a conference  table.  Further 


research  In  this  area  should  deal  with  the  various  ways  a decision 


aid  could  aggregate  and  display  Information  useful  In  helping  the 


group  reech  a consensus. 


2 . A . 2 Encoding  Values  and  Preferences 


The  development  of  automated  decision  aids  for  encoding  values 


and  preferences  may  have  to  wait  until  th<-  theoretical  basis  for 


alternative  encoding  procedures  has  been  established.  A number  of 


different  encoding  procedures  have  been  used  In  recent  years,  some 


of  which  are  Inconsistent  with  certain  formulations  of  utility 


theory. 


For  example,  one  encoding  procedure  requires  the  subject  to 


Indicate  the  value  of  a particular  outcome  (along  a particular  di- 


mension) by  deciding  where  the  outcome  stands  on  a scale  of  100, 


where  0 corresponds  to  the  worst  possible  outcome  and  100  corresponds 
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to  the  best  possible  outcome.  In  this  case,  If  the  subject  picks 
a score  of  50,  he  is  saying  that  the  Incremental  value  of  this  out- 
come relative  to  the  worst  possible  outcome  Is  about  1/2  of  the 
Incremental  value  of  the  best  possible  outcome. 

However,  this  approach  Is  inconsistent  with  the  formulation 
of  utility  theory  upon  which  much  of  the  decision  analysis  is 
based.  One  of  the  Implications  of  utility  theory  is  that  when  an 
individual's  preferences  have  been  described  on  a particular 
utility  scale,  any  monotonlcally-increasing  transformation  of  that 
scale  will  result  in  an  equally  valid  utility  scale  describing 
the  same  preferences.  This  means  that  the  statement  that  an  indi- 
vidual likes  one  outcome  half  as  much  as  another  can  be  transformed 
to  a different  scale  in  whic.  the  individual  likes  the  first  out- 
come 1/3  as  much  as  the  second.  Which  scale  was  the  subject  think- 
ing about  when  he  said  that  he  liked  one  outcome  half  as  much 
as  the  other?  The  subject  would  probably  have  a great  deal  of 
difficulty  answering  this  question  since  his  preferences  are  be- 
ing measured  on  an  arbitrary  utility  scale  that  has  no  physica. 
interpretation. 

Once  the  theoretical  difficulties  have  been  resolved,  we 
can  develop  automated  aids  for  encoding  values  and  preferences 
that  are  both  practical  and  theoretically  sound.  These  aids  could 
be  especially  useful  for  problems  which  require  complex  value 
judgments.  1-or  example,  It  is  frequently  neccessary  to  elicit 
preferences  over  multi-dimensional  outcomes.  Aids  for  multi- 
dimensional value  encoding  could  be  designed  to  help  an  individual 


decompose  a difficult  value  assessment  into  several  value  dimensions 
(cost,  time  to  completion,  loss  of  life,  political  effects,  etc.) 
that  are  relatively  easy  to  think  about.  Preferences  could  be 
elicited  individually  on  each  value  dimension  and  then  aggregated 
to  determine  multl-dlmenslonal  value  assessment.  As  an  additional 
aid,  trade-off  boundaries  among  the  various  value  measures  could 
be  graphically  Illustrated. 

Further  reeeerch  on  thl.  topic  le  Inpottant  since  values  and 
preferencea  are  central  laauee  In  moat  public  sector  decision  anal- 
ysis. Initial  efforts  at  automation  will  be  to  build  support  ays- 

tems  for  a human  Interviewer  rather  than  to  fully  automate  encoding 
techniques. 

Encoding  Time  and  Risk  Preferencp 
Encoding  risk  preference  means  determining  an  individual's 
attitude  toward  uncertain  situations  in  which  there  is  a chance 
of  outcomes  with  very  serious  consequences.  When  faced  with 
a decision  involving  his  well-being  or  major  portions  of  his  as- 
sets, a decision  maker  may  be  unwilling  to  "play  the  averages". 
Decision  analysts  use  the  concepts  of  risk  aversion  and  utility 
functions  to  deal  with  this  phenomena. 

Most  techniques  for  encoding  an  individual's  attitude  toward 
risk  are  designed  to  generate  a utility  function  which  specifies 
risk  attitude  over  a range  of  possible  outcomes.  An  encoding  pro- 
cess, usually  taking  the  form  of  an  interview  between  the  analyst 
and  decision  maker,  is  used  to  determine  the  utility  function.  The 
decision  maker  is  asked  to  choose  among  a set  of  reference  lotteries. 
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His  choices  are  th“n  analyzed  to  derive  the  utility  function. 

In  the  process  of  conceptualizing  and  expressing  his  attitude 
toward  risk,  a subject  may  unconsciously  distort  his  beliefs  In 
much  the  same  way  that  he  can  unconsciously  bias  subjective  prob- 
ability estimates  (see  Section  2.4.1,  Individual  Probability  En- 
coding). For  example,  most  subjects  exhibit  the  "zero  Illusion". 
This  means  that  Individuals  tend  to  base  their  thinking  about 
risky  situations  on  what  they  perceive  their  current  level  of 
assets  to  be  even  though  they  may  not  know  their  current  level  of 
assets.  Procedures  are  needed  for  overcoming  this  sort  of  dis- 
tortion In  an  Individual's  assessment  of  risk  preference. 

The  assessment  of  a decision  maker's  attitude  toward  risk  be- 
comes rather  complex  when  the  possible  outcomes  are  distributed 
over  time.  It  can  be  shown  that  an  Individual's  attitude  toward 
uncertain  situations  depends  not  only  on  the  values  of  various 
outcomes  and  the  time  In  which  they  might  occur,  but  also  on 
the  time  at  which  the  uncertainties  associated  with  the  outcomes 
are  resolved. 

For  example,  consider  the  two  lotteries  shown  In  Figure  2.32. 
In  both  lotteries  there  Is  a 50%  chance  of  winning  $10,000  and 
a 50%  chance  of  winning  nothing.  Furthermore,  In  both  lotteries 
the  $10,000  Is  received  one  year  from  the  present  time.  However, 

In  the  first  lottery  the  uncertainty  Is  resolved  luznedlately , 
while  In  the  second  lottery  the  lottery  Is  not  resolved  for  a 
year.  Vfhen  asked  to  choose  between  two  lotteries,  most  Individuals 
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will  choose  the  first  because  immediate  resolution  of  the  uncer- 
tainty associated  with  the  lottery  allows  them  to  plan  their  con- 
sumption over  time. 

Procedures  are  needed  to  determine  the  relative  value  of 
lotteries  such  as  those  shown  In  Figure  2.32.  Recent  theoretical 
research  In  time-risk  preference  has  Indicated  that,  for  moat 
problems,  an  individual's  attitude  toward  both  time  and  risk 
preference  can  be  assessed  In  terms  of  a few  simple  parameters. 
Further  research  Is  needed  to  develop  these  procedures  Into  a 
set  of  concepts  that  can  form  the  basis  for  an  au-.omated  decision 
aid  designed  to  encode  time-risk  preference. 

Generation  and  Elicitation  of  Alternatives 

A good  alternative  can  often  be  more  valuable  than  the  care- 
ful selection  of  a course  of  action  from  a set  of  poor  alternatives. 
Executives  faced  with  a difficult  decision  often  spend  a good  por- 
tion of  their  time  searching  for  a better  alternative.  However,  very 
little  research  has  been  done  to  develop  methods  for  helping  the 
decision  maker  generate  new  alternatives  and  Incorporate  them  into 
an  analysis  of  the  decision  problem. 

Determining  the  value  of  information  and  flexibility  can  be 
viewed  as  one  way  to  generate  new  alternatives.  In  this  caso, 
the  new  alternative  Is  the  possibility  of  buying  Information  before 
making  the  primary  decision.  However,  while  new  Information  can 
cause  a decision  maker  to  pick  a different  alternative.  It  does 

not  offer  him  any  fundamentally  different  alternatives  when  he  faces 
the  primary  decision. 
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It  may  be  possible  to  elicit  new  alternatives  from  a deci- 
sion maker  by  having  him  conceptualize  possible  combinations  of 
existing  alternatives  and  looking  for  hedging  strategies  that 
combine  the  desirable  features  of  two  or  more  existing  alterna- 
tives. For  example,  an  executive  trying  to  decide  whether  or  not 
to  undertake  a risky,  but  potentially  very  profitable,  investment 
starts  with  two  alternatives:  to  Invest  or  not  invest.  It  may 

be  possible  to  elicit  intermediate  alternatives  by  having  the 
subject  consider  various  forms  of  risk  sharing,  which  have  the 
effect  of  reducing  both  the  potential  losses  and  the  potential 
gains  associated  with  the  Investment. 

We  need  to  know  a great  deal  more  about  the  generation  and 
elicitation  of  alternatives  before  we  can  start  designing  decision 
aids  to  accomplish  these  tasks. 
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FIGURE  2.3n  EXPANDED  MODEL 


FIGURE  2.3  MODELS  OF  A COAL  BURNING  POWER  PLANT 


SECTION  3 


AN  ILLUSTRATIVE  IMPLEMENTATION  OF  THE  MORPHOLOGY: 

A COMPUTERIZED  GRAPHICAL-ALGEBRAIC  TECHNIQUE  FOR  MODEL  BUILDING 


In  this  section  we  shall  discuss  some  preliminary  results 
concerning  the  application  of  the  decision  morphology  to  the  de- 
velipment  of  a system  of  computer  aids  for  decision  analysis. 

The  first  part  of  this  section  presents  some  requirements  for  a 
successful  computerized  system  for  decision  making.  The  latter 
parts  of  this  section  describe  how  the  graphical  language  dis- 
cussed In  Sections  2.1.1  and  2.3.2  might  be  used  for  model  build- 
ing and  now  this  technique  might  be  usefully  Implemented  as  part 
of  a computerized  system  for  decision  analysis. 


3.1 


CHARACTERISTICS  OF  A SUCCESSFin.  SYSTEM 
DECISION  ANALYSIS 


OF  COMPUTER  AIDS  FOR 


Recent  advances  In  computer  hardware  and  software  technology, 
Including  the  development  of  visual  aids  and  the  Introduction  of 
time  sharing  systems,  have  tremendously  Increased  the  potential 
scope  of  computer  a^lysls.  User-machine  Interaction  has  progressed 
to  the  point  where  now  find  ourselves  In  an  era  In  which  the 
computer's  powerful  processing  and  data-handllng  capabilities  may 
be  used  to  extend  greatly  human  reasoning  ability  and  insight. 
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Several  attempts  have  been  made  to  develop  computer  program.-* 
to  be  used  as  aids  for  decision  modeling.*  Certain  deficiencies 
in  these  programs,  however,  have  tended  to  limit  their  usefulness. 
One  of  the  most  significant  limitations  of  existing  systems  is  a 
lack  of  flexibility.  Designing  computer  aids  requires  striking  a 
compromise  between  the  needs  of  the  user  and  the  difficulty  of  im- 
plementing the  procedure  on  the  computer.  Too  often  the  compromise 
is  at  the  expense  of  the  user. 

We  believe  that  we  will  ultimately  achelve  a better  design  if 
we  Initially  ignore  the  constraints  of  existing  computer  systems, 
identifying  first  the  basic  requirements  that  the  system  must  pos- 
sess to  be  successful.  Some  of  these  requirements  are  essential 
to  any  computerized  system  that  is  designed  to  support  modeling 
activity.  If  the  system  is  designed  specifically  to  aid  decision 
making,  it  is  desirable  that  it  possess  certain  additional  capabil- 
ities . 

3.1.1  System  Language  Flexibility 

As  stated  above,  flexibility  is  an  Important  characteristic 
for  any  system  which  is  to  be  used  in  modeling.  Of  main  concern 
for  supplying  flexibility  is  the  adequacy  of  the  system  language 
for  user-machine  communication.  The  system  language  must  permit 
the  user  to  become  directly  Involved  with  his  problem  rather  than 


See,  for  example,  Dahl  and  Nygnord  [2],  Groner  et.  al.  [ 3 ], 
IBM  [ 5 ],  IBM  [ 6 ],  Klvlat  et.al.  [ 7 ],  Zamora  and  Leaf  CL3  j. 
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with  the  computei . Therefore,  the  language  of  communication 
should  be  so  natural  that  the  user  can  devote  his  main  attention 
to  monitoring  the  status  of  his  model.  Graphics  capability  is  an 
important  aspect  for  many  users,  not  only  because  plots  are  a nat- 
ural means  for  representing  data,  but  also  because  the  relation- 
ships between  model  entitles  and  operators  are  much  easier  to  grasp 
if  presented  visually.  The  readability  and  formatting  capabilities 
of  a graphics  display  allow  fast,  selective  scanning  of  large  a- 
mounts  of  data.  The  user  can  switch  quickly  among  various  blocks 
of  information  to  analyze  diverse  aspects  of  modeling. 

The  command  language  must  be  concise,  convenient,  and  effi- 
cient in  accessing  all  system  facilities.  It  must  be  versatile, 
including,  for  example,  the  ability  to  stack  commands  before  exe- 
cution, to  cancel  a Jlat  of  commands,  and  to  define  macro  commands 
composed  of  other  commands.  A facility  is  also  needed  to  allow 
extensions  to  the  command  language  to  provide  for  problem  depen- 
dent operation. 

It  should  be  possible  to  tailor  the  system  language  to  fit 
the  class  of  models  being  constructed.  When  appropriate,  the  lan- 
guage should  provide  special  purpose  statements  which  allow  direct 
and  simple  specification  of  all  basic  model  characteristics.  As 
much  of  the  definition  of  the  model  as  possible  should  be  done  for 
the  user  so  he  need  supply  only  particulars  and  can  concentrate 
on  the  unique  parts  of  his  system.  In  addition,  the  language 
should  provide  programmed  routines  for  standard  methods  of  defining 
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common  characteristics  of  the  model.  Such  routines  for  model 
definition  are  essential  for  large  scale  systems. 

3.1.2  Multi-Level  Operation 

In  addition  to  tailoring  the  system  language  to  the  class  of 
modeling  job,  it  must  also  be  tailored  to  t.  t type  of  user.  In 
order  to  reach  the  largest  population  of  potential  users,  a compu- 
terized system  of  decision  aids  would  have  to  be  developed  to  oper- 
ate differently  depending  upon  the  skills  and  objectives  of  the 
user.  We  envision  a hierarchy  of  declsio:.  aids  having  four  basic 
levels  of  operation:  Level  I for  the  decision  maker  relatively 

unfamiliar  with  decision  analysis  and  the  operation  of  the  computer 
system;  level  II  for  the  "analyst"  moderately  experienced  with 
the  concepts  of  decision  analysis;  level  III  for  the  analyst  with 
a thorough  understanding  of  decision  analysis  methodology  and  good 
prograinaing  ability;  and  level  IV  for  the  "system  programmer"  who 
designs  and  extends  the  system's  capabilities.  Table  3.1  summarizes 
these  four  levels  of  system  operation.  The  various  levels  of  op- 
eration are  hierarchically  connected  in  the  sense  that  one  of  the 
objectives  of  working  in  the  higher  levels  (levels  III  and  IV)  1s 
to  expand  the  capabilities  of  the  system  at  lower  levels  of  opera- 
tion (levels  I and  II).  Since  it  will  occasionally  be  desirable 
to  build  tailor-made  computational  aids  to  fit  unique  situations, 
the  hierarchical  structure  of  the  system  will  provide  the  r eans  for 
bulldlrg  new  tools  as  needed.  In  this  way,  computerized  tools  can 

be  developed  for  staff  and  line  uses,  strategic  and  tactical  deci- 
sions, o.k’  planning  and  crisis  environments. 
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Analytical  Capabilities  for  Decision  Analysis 


To  be  successful,  of  course,  the  language  for  any  modeling 
system  must  be  sufficiently  general  that  the  user  can  propc.-ly 


describe  the  behavior  required  of  his  model.  It  must  contain  an 


adequate  range  of  data  primitives,  basic  logical  and  arithmetic 


operations,  conditional  and  unconditional  branch  facilities,  an 
Iterative  capability,  and  provisions  for  the  use  of  other  soft- 
ware subsystems. 

Comprehensive  facilities  for  measuring  the  model's  perfor- 
mance are  an  essential  requirement.  The  system  must  contain  a 
number  of  consistency  checks  to  give  the  user  confidence  that  the 
tools  are  being  used  properly.  These  checks  will  force  the  user 
to  clarify  his  assumptlois,  verify  the  consistency  of  his  prefer- 
ences, and  ch»ck  his  state  o Infomation.  Certain  basic  calcu- 
lations pertaining  to  decision  analysis,  such  as  sensitivity  analysis, 
optimization  functions,  and  probability  processing  techniques,  are 
necessary.  Since  for  larger  problems  some  of  these  calculations 


may  be  beyond  the  computational  capabilities  of  present  generation 
computers.  It  may  be  useful  to  conceive  of  various  levels  of  imple- 
mentation for  these  computational  abilities.  Initially  an  effort 
would  be  m->do  to  Implement  only  the  lower  levels  of  computational 
capabilit:.es;  the  higher  levels  would  be  implemented  as  computer 
hardware  and  software  technology  progressed.  Table  3.2  lists  three 
levels  of  progressively  more  advanced  computational  capabilities 
for  decision  model  design  and  analysis. 


i 


♦ 
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TABLE  3.2 


CAPABILITIES  OF  MODELING  AID 


LEVELS 


ANALYTICAL  FUNCTIONS 
SENSITIVITIES 

I/O  SENSITIVITY 
(VALUE  OF  AN  OUTPUT  AS 
AN  INPUT  IS  VARIED) 


SENSITIVITY  TO  A 
SINGLE  VARIABLE 


JOINT  SENSITIVITY  MULTI-VARIABLE 


TO  TWO  VARIABLES 


JOINT  SENSITIVITY 


TRADE-OFF  SENSITIVITY 
(VALUE  OF  ONE  INPUT  AS 
ANOTHER  INPUT  IS  VARIED 
HOLDING  OUTPUTS  FIXED) 


SENSITIVITY  OF 
ONE  INPUT  TO 
ANOTHER 


SENSITIVITY  OF 
ONE  INPUT  TO 
ANOTHER  WITH 
CONSTRAINTS 


CHANGE  RATES 
(PARTIAL  DERIVATIVES) 


DERIVATIVE  OF 
OUTPUT  TO  INPUT, 
FIRST  AND  SECOND 


DERIVATIVE  OF 


HIGHER  ORDER 


OUTPUT  TO  SEVERAL  DERIVATIVES 
INPUTS,  TRADE-OFF 
DERIVATIVES 


OPTIMIZATION 
OPTIMIZATION  OP 
DETERMINISTIC  MODEL 


SINGLE  DECISION 
VARIABLE 


MULTIPLE  DECISION 
VARIABLES 


OPTIMIZATION  OF 
PROBABILISTIC  MODEL 


SINGLE  DECISION 
VARIABLE 


MULTIPLE  DECISION  DYNAMIC  DECISION 
VARIABLES , STATIC  PROBLEMS 
PROBLEMS  • 


PROBABILITY  PROCESSING 
PROFIT  LOTTERY  GENERATION 


SEVERAL  INDEPENDENT  PROBABILISTIC  ARBITRARY  PROBABILISTIC 

PROBABILITY  DEPENDENCIES  DEPENDENCIES  WITH  AUTOMATIC 

DISTRIBUTIONS  WITHOUT  AUTOMATIC  BAYES  RULE  PROCESSING 

BAYES  RULE  PROCES-  AND  CONSISTENCY  CHECKING 


VALUE  OF  INFORMATION 
GIVEN  n.EXIBILITY 


PROBLEM  STRUCTURE  VA' UE  OF  INFOR- 
REDEFINED  BY  USER  MATION  FOR  NON- 


VA'UE  OF  INFOR-  VALUE  OF  INFORMATION 

MATION  FOR  NON-  AND  FI.FJCIBILITY  WITH 

OECI  IION-DEI’ENDKNT  AUTOMATIC  I’KOCESSlNCi 
VARI.BLES  OF  DECISION-DEPENDENT 


VARIABLES 


PROXIMAL  ANALYSIS 


NO  JOINT  EFFECTS 


CORRELATION  AND 


HIGHER  ORDER 


INTERACTION  AMONG  APPROXIMATIONS 
VARIABLES 
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3. 2 A GRAPHICAL  LANGUAGE  FOR  MODEL  DEVELOPMENT 


One  contribution  of  our  research  effort  to  develop  a mor- 
phology for  characterizing  and  analyzing  decision  problems  has 
been  the  development  of  a graphical-algebraic  language  for  de- 
.-ision  model  specification.  The  basic  elements  of  this  language, 
entities  and  operators,  were  defined  in  section  2.1.  In  that 
section  we  showed  how  entitles  and  operators  could  be  combined  to 
represent  system  models.  In  this  section  we  describe  how  this 
language  may  serve  as  the  basis  for  a technique  for  model  develop- 
ment. In  addition,  we  illustrate  how  this  technique  might  be  im- 
plemented as  a computerized  system  for  decision  analysis. 

By  far  the  moat  difficult  and  time  consuming  part  of  a decision 
analysis  is  the  development  of  a decision  model  that  captures  the 
important  elements  of  the  problem.  Even  though  the  resulting  model 
may  be  simple  in  form,  considerable  effort  is  _lkely  to  be  re- 
quired to  choose  problem  variables  and  model  parameters  so  as  to 
represent  adequately  the  essential  aspects  of  the  decision. 
Increasingly,  though,  resource  allocation  problems  involve  ex- 
tremely complex  systems.  For  example,  the  choice  among  pollution 
abatement  technologies  for  an  electric  power  plant  requires  the 
understanding  of  a system  whose  behavior  patterns  cannot  be  dis- 
cerned from  simplified  approximations.  Such  systems  may  be  quite 
large;  their  bounds  are  not  determined  by  physical  size,  but  rather 
by  how  much  we  need  to  know  about  the  way  the  system  Interacts  with 
its  environment.  For  example,  for  the  decision  among  sulfur  oxide 
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pollution  abatement  strategies  for  an  electric  power  plant,  the 
system  of  Interest  Is  u!uch  larger  than  merely  the  power  plant. 

®bher  elements  which  must  be  Included  In  the  system  Include  the 
atmospheric  conditions  that  govern  the  dispersal  of  the  sulfur 
oxides  and  the  resulting  human  population  which  becomes  so  exposed. 

Thus,  an  Important  problem  to  be  solved  In  the  course  of  de- 
velopment of  computer  aids  for  decision  making  Is  to  develop  a 
language  for  compactly  and  efficiently  deriving  and  expressing  an 
appropriate  model  that  describes  the  decision  problem.  The  task 
of  deriving  a model  of  a system  may  be  divided  broadly  Into  two 
subtasks:  establishing  the  model  structure  and  supplying  the  data. 

In  Section  2.1  we  described  a method  lor  concisely  specifying 
model  structure.  The  method  was  originally  developed  to  represent 
the  deterministic  dependencies  In  continuous  static  models.  How- 
ever, we  shall  see  In  the  latter  part  of  this  chapter  that  the 
method  may  be  extended  to  apply  to  sequential  systen.s  containing 
discrete  events  as  well.  Few  modeling  techniques  are  sufficiently 
general  that  they  can  be  applied  to  a broad  cross-section  of  the 
model  types  discussed  In  Section  1.3. 

Any  system  associated  with  a resource  commitment  problem  will 
contain  certain  objects  of  Interest.  For  the  system  describing 
sulfur  oxide  pollution  from  an  electric  power  plant,  objects  of  In- 
terest Include  the  amount  of  electricity  generated,  the  quantity 
of  sulfur  oxide  emitted  from  the  stacks,  and  the  population  downwind 
from  the  plant.  Entitles  will  be  used  to  denote  objects  of  Interest 
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in  a system.  Model  structure  Is  defined  by  relationships  which 
exist  between  the  various  system  entitles.  An  example  would  be 
the  mathematical  relationship  that  might  exist  between  the  quantity 
of  electricity  generated  and  power  plant  sulfur  emissions.  "Oper- 
ators" will  be  used  to  represent  such  relationships  among  entitles. 

A useful  property  of  the  concepts  of  entitles  and  operators 
was  Illustrated  In  Section  2. 1;  they  allow  us  to  express  graph- 
ically model  structure.  The  proposed  technique  of  graphical  rep- 
resentation has  been  applied  to  the  syrtem  for  analyzing  sulfur 
oxide  pollution  abatement  strategies  from  power  plants.*  About 
one-third  of  the  resulting  "branching  structure"  is  Illustrated 
In  Figure  3.1. 

In  such  branching  struc  ires,  entitles  are  represented  graph- 
ically by  blocks.  The  name  or  description  of  the  entity  Is  written 
within  the  block.  Triangles  represent  operators  and  a line  connect- 
ing an  operator  to  an  entity  expresses  the  fact  that  the  rela- 
tionship among  entitles  represented  by  the  operator  Includes  that 
entity.  Entlti.es  nearer  the  top  of  the  branching  structure  may  be 
characterized  as  being  more  fundamentally  Important  for  Judging 
the  success  or  failure  of  a decision  strategy.  Entities  nearer  to 
the  bottom  of  the  structure  are  the  more  elemental  properties  of 
the  system.  In  particular,  those  blocks  which  have  no  entering 
arrows  are  the  most  elemental  system  entitles. 


This  problem  was  the  subject  of  a decision  analysis  recently  com- 
pleted by  SRI  for  the  National  Academy  of  Science. 
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The  lines  between  entitles  and  operators  shown  In  Figure  3.1 
represent  deterministic  dependencies,  and  the  arrows  on  these  lines 
define  a direction  for  computation.  The  rule  satisfied  by  the  con- 
nections between  operators  and  entitles  is  that  given  fixed  values 
for  all  entitles  with  arrows  leading  to  an  operator  (input  entitles), 
a unique  value  Is  specified  for  all  entitles  lying  along  arrows 
leading  from  that  operator  (output  entitles). 

Elemental  entitles  (those  entitles  In  Figure  3.1  with  no  enter- 
ing arrows)  may  be  classified  as  decision  variables  or  as  state 
variables.  Decision  varlajles  are  entities  whose  values  represent 
.leclslon  alternatives  and,  hence,  are  set  by  the  decision  maker. 

£n  Figure  3.1  the  elemental  entitles  "Type  coal  consumed",  "Coal 
washing  technology",  and  "FGD  (Flue  Gas  Desulfurization)  technol- 
ogy" are  decision  variables  representing  possible  means  of  sulfur 
oxide  emission  control  available  for  the  electric  power  plant. 
Decision  variables  are  represented  graphically  by  rectangular 
^®ther  than  circular  blocks.  The  remaining  elemental  entitles 
represent  either  parameters  or  state  variables— entitles  whose 
values  are  determined  by  nature.  Thua,  the  branching  structure, 
when  combined  with  the  computational  rule  assignments  for  each 
operator,  graphically  represents  the  decision  model's  deterministic 
value  structure.  Given  specific  decision  alternatives  for  each 
decision  variable  and  specific  values  for  all  state  variables, 
the  value  of  the  fundamental  entity  whose  level  determines  the  net 
worth  of  the  decision  outcome  may  be  calculated. 
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An  algorithm  for  constructing  a branching  structure  such  as 
that  of  Figure  3.1  will  be  given  below,  where  we  describe  a compu- 
terized system  designed  to  aid  a decision  maker  in  model  develop- 
ment. Later,  we  shall  show  how  an  "influence  diagram"  may  be  com- 
bined with  the  branching  structure  for  the  deterministic  value  model, 
to  represent  dynandc  learning  effects  in  the  model. 

3.2.1  CADMUS  (Computer  Aids  for  Decision  Makers;  User  System) 

What  follows  is  a tentative  description  of  the  operation  of 
an  interactive  computer  graphics  system  for  decision  making.  We 
shall  call  this  system  CAIWUS  , an  acronym  for  Computerized  Aids 
for  Decision  Makers:  User  System.  Although  the  characteristics 

which  we  ascribe  to  CADMUS  are  within  the  capabilities  of  present 
generation  hardware  and  software  technology,  our  objective  is  to 
communicate  a perception  of  how  such  a system  might  usefully  em- 
ploy branching  structures  as  a language  for  model  building.  Our 
objective  is  not  to  define  the  detailed  characteristics  of  such  a 
system.  Before  we  becomt*  lost  in  the  particulars  of  designing 
computer  systems,  we  need  to  improve  further  our  understanding  of 
the  alternative  ways  of  describing  decision  problems. 

To  Illustrate  our  perception  of  how  CADMUS  might  use  branching 
structures  we  shall  use,  as  an  example,  the  problem  of  choosing  be- 
tween sulfur  pollution  abatement  strategies  for  fixed  coal  burning 

•k 

According  to  Greek  mythology,  Cadmus  was  a Phoenician  prince  repu- 
ted to  have  killed  a dragon.  Sowing  the  teeth  of  the  dragon,  Cad- 
mus produced  an  army  of  armed  men. 
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electric  power  plants.  Due  to  the  scope  of  the  original  analysis 
for  this  problem,  a static  model  was  chosen.  State  variables  in 
this  model  are  for  the  most  part  continuous.  Branching  structures 
are  especially  appropriate  for  representing  the  model  structure 
for  problems  with  these  characteristics. 

We  assume  that  the  system  user  in  our  example  has  some  famil- 
iarity with  decision  analysis.  This  would  put  him  somewhere  in 
between  levels  1 and  2 of  user  experience  as  outlined  in  Table  3.1. 

A Brief  Deeaviption  of  the  Sulfuj'  Problem 

Sulfur  oxide  and  particulate  emissions  have  adverse  conse- 
quences for  human  health  and  welfare,  but  the  means  for  controlling 
these  emissions  entail  considerable  expense.  The  decision  problem 
considered  here  concerns  the  choice  between  alternative  sulfur 
emission  abatement  technic  'es  for  a representative  620MW  coal  burn- 
ing electric  power  plant  located  in  a rural  area  roughly  500km  up- 
wind from  the  New  York  Metropolitan  area.  Most  of  the  sulfur  con- 
tent of  coal  is  released  upon  combustion  as  sulfur  dioxide,  but 
atmospheric  chemical  processes  may  oxidize  the  sulfur  dioxide  to 
sulfuric  acid  aerosol,  and  suspended  particles  of  ammonium  sulfate 
and  other  sulfate  salts.  Recent  epidemiological  data  have  indicated 
that  these  sulfates  may  give  rise  to  serious  and  widespread  health 
effects.  Damage  to  material  property  from  atmospheric  sulfur  oxides 

**As  stated  in  a previous  footnote,  this  problem  was  recently  analyzed 
by  the  Decision  Analysis  Group  at  SRI.  The  results  of  this  analysis 
were  delivered  to  the  U.S.  Senate  on  March  3,  1975. 
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has  been  estimated  to  cause  hundreds  of  millions  of  dollars  in 
annual  losses.  Acid  rain  resulting  from  atmospheric  sulfur  ox- 
ides may  lead  to  retarded  growth  in  forests,  deleterious  effects 
on  lakes  and  streams,  diunage  to  agricultural  crops,  and  damage 
to  building  materials,  statues  and  ot  er  material  property. 

While  SO2  is  Invisible,  sulfate  particles  do  absorb  and  scatter 
light  and,  hence,  may  be  partially  responsible  for  visibility  deg- 
radation. 

The  decision  problem  on  emissions  control  is  ultimately  whether 
the  owners  of  a power  plant  shall  modify  their  operations  by  such 
means  as  installing  a flue  gas  desulfurlzatltn  (FGD)  process, 
switching  to  a low  sulfur  content  fuel,  or  Installing  a taller 
stack  and  intermittent  control  system.  The  adoption  of  the  emis- 
sion control  strategy  will  result  in  higher  costs  to  the  owners 
of  the  power  plant,  and  these  higher  costs  will  generally  be 
passed  on  as  higher  prices  to  the  consumers  o jlectrlclty. 


Therefore,  obtaining  an  optimal  emissions  control  strategy  in- 
volves determining  the  cost-benefit  trade-offs  from  using  the  var- 
ious alternative  means  for  control.  The  benefits  from  adopting 
the  emissions  control  strategy  come  from  the  change  in  amount  (and 
timing)  of  emissions  into  the  atmosphere  of  sulfur  oxide  and  other 
materials  that  may  adversely  affect  human  health,  cause  danger  to 
other  living  organisms  or  material  property,  and  result  In  effects 
such  as  visibility  reduction  that  are  aesthetically  undesirable. 

Th'j  costs  from  adopting  the  strategy  are  the  higher  costs  of 
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producing  electricity.  A decision  between  alternative  strategies 
requires  a balancing  of  the  additional  cost  Imposed  on  the  genera- 
tion of  electric  p<»er  against  the  value  of  emissions  reduction. 

For  the  purposes  of  the  analysis,  the  criteria  for  choosing  among 

the  alternative  strategies  was  chosen  to  be  minimization  of  total 
social  cost  to  society. 

i!g.ins  CADMUS  to  Analyze  the  Sulfur  ProMem 
Let  us  Imagine  that  CABMUS,  our  computerized  system  of  deci- 
sion aids,  has  been  built.  How  might  It  be  used  by  a decision 
maker  Interested  In  modeling  and  analyzing  the  sulfur  emissions 
problem?  He  begins  by  sitting  down  before  hie  locsl  computer 
driven  terminal  with  video  screen  and  throws  a switch  on  the  con- 
sole Indicating  his  request  for  CADMUS.  A list  of  computer  aids 
for  decision  analysis  appears  Instantly  on  the  screen,  and  our 
decision  maker  Indicate  his  wish  for  assistance  In  model  develop- 
ment by  touching  the  light  pen  attached  to  his  terminal  to  an  ap- 
propriate  Item  in  this  Use. 

Instantaneously,  the  video  screen  Is  transformed  Into  the 
control  panel  Illustrated  In  Figure  3.:!.  The  center  of  the  control 
panel,  which  displays  messages  from  the  computer  system,  may  also  be 
used  as  a "scratch  pad"  for  drawing,  typing,  or  writing.  As  the 
light  pen  Is  pulled  across  this  area,  a displayed  "Ink"  track  appears 
to  flow  from  the  pen.  Items  appearing  here  may  be  erased  by  scrub- 
bing over  them  with  the  pen.  Around  the  edges  of  the  screen  are 
various  control  "pushbuttons";  If  one  of  these  Is  "pushed"  (by 


161 


FIGURE  3.2  CONTROL  PANEL  FOR  MODEL  FORMULATION 


touching  the  pen  to  it),  the  system  performs  the  indicated  action. 

The  buttons  in  the  lower  right  hand  corner  of  the  screen  form  a 

t 

calculator"  for  writing  mathematical  or  logical  equations.  The 
buttons  on  the  left  of  the  screen  are  for  system  control. 

The  following  question  appears  at  the  center  of  the  video 
screen: 


WHAT  QUANTITY  OR  QUANTITIES  WOULD  YOU  NEED  TO  KNOW  TO  EVALUATE 
THE  OUTCOME  OF  YOUR  DECISION? 

A^ter  thimcing  for  a moment,  our  decision  maker  decides  that  he 
could  evaluate  a given  emission  abatement  strategy  if  he  could 
foretell  the  total  social  cost  per  kilowatt  hour  of  electricity 
produced  that  the  strategy  would  place  on  society.  He,  therefore, 
types  TOTAL  SOCIETAL  COST/KWH  on  the  computer  terminal.  CADMUS 
responds  with  another  question: 

SUPPOSE  YOU  HAD  A CRYSTAL  BALL.  YOU  M.\Y  ASK  IT  ANY  NUMERI- 
CAL QUESTION  EXCEPT  "WHAT  IS  'TOTAL  SOCIETAL  COST/KWH'?" 

FOR  WHAT  QUANTITY  OR  QUANTITIES  WOULD  YOU  ASK  IN  ORDER  TO 
CALCUL/:TE  "TOTAL  SOCIETAL  COST/KWH"? 

Our  decision  maker  reafions  that  total  societal  costs  will  be 
the  sum  of  the  costs  of  electricity  generation  and  pollution  costs. 
He  types  ELECTRIC  COST/KWH  and  the  POLLUTION  COST/KWH.  Immediately 
the  video  screen  represents  these  entires  as  entities  in  a graphical 
structure  (Figure  3.3). 

The  relationship  between  the  three  entities  is  represented 
graphically  by  an  "operator"  dot,  to  which  CADMUS  hcs  assigned  the 
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FIGURE  3.3  STEP  ONE  FOR  MODELING  THE  SULFUR  POLLUTION  PROBLEM 


nunber  1.  To  specify  an  analytic  definition  for  the  operator  the 
decision  maker  addresses  his  attention  to  the  calculator  in  the 
lower  right  hand  comer  of  the  screen.  Thinking  "total  societal 
cost  will  be  the  sum  of  electric  cost  and  pollution  cost,"  he 

A 

uses  his  light  pen  to  write 

j-^  /ELECTRIC'N  ^POLLUTION^v 
yCOST/KWHy  I 1 V COST/KWH  ) 

by  alternately  touching  the  appropriate  entit'  blocks  in  the 
branching  structure  and  operator  buttons  on  the  calculator.  As 
he  proceeds,  the  equation  defining  operator  number  one  appears  at 
the  bottom  of  the  video  screen. 

The  decision  maker  touches  the  light  pen  to  the  entity  block 
marked  "pollution  cost/kwh"  and  CADMUS  answers; 

SUPPOSE  YOU  HAD  A CRYSTAL  BALL.  YOU  MAY  ASK  ANY  NUMERICAL 
QUESTION  EXCEPT  "WHAT  IS  'POLLUTION  COST/KWH'?"  FOR  WHAT 
QUANTITY  OR  QUANTITIES  WOULD  YOU  ASK  IN  ORDER  TO  CAI.CULATE 
"POLLUTION  COST/KWH"? 

"Well,"  thinks  our  decision  maker,  "I  can  calculate  the  number  of 
pounds  of  sulfur  emitted  from  the  stacks  per  kilowatt  hour,  so  if 
I knew  the  pollution  cost  per  pound  of  sulfur  emitted  1 could  cal- 


TOTAL ^ 

SOCIETAL 

COST 


As  mentioned  above,  a user  may  "push"  a "button"  illustrated  on 
the  vidc*o  screen  by  touching  that  button  with  the  light  pen.  In 
the  text  we  represent  the  pushing  of  a button  by  enclosing  the 
button  label  within  a rectangular  figure.  For  permanent  control 
buttons  the  rectangular  figures  have  right-angled  corners.  User 
defined  entity  buttons  are  enclosed  within  figures  with  rounded 
corners.  Rectangular  blocks  are  not  placed  around  those  items 
that  are  entered  through  the  terminal  keyboard. 
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culace  the  pollution  cost  per  kilowatt  hour.”  He  types  POLLUTION 
COST/LB  SULFUR  EMITTED  and  LBS  SULFUR  EMITTED/iaffl,  causing  the 
branching  structure  to  disappear  momenirarlly  then  reappear  as  shown 
In  Figure  l.A.  Using  the  light  pen,  the  entity  blocks  In  the 
branching  structure,  and  the  "calculator"  In  the  left  hand  corner 
of  the  screen,  our  decision  maker  "pushes"  the  right  buttons  so  as 
to  express  pollution  cost  per  kilowatt  hour  as  the  product  of  pol- 
lution cost  per  pound  of  sulfur  emitted  and  the  number  of  pounds 
of  sulfur  emitted  per  kilowatt  hour.  The  equation  appears  near 
the  bottom  of  the  screen  as  shown  In  Figure  3.4. 

Next  our  decision  maker  touches  his  light  pen  to  the  block 
marked  "electric  cost/kwh".  The  familiar  question,  this  time  asking 
him  what  he  would  need  to  know  to  define  "electric  cost/kwh," 
appears  on  the  screen.  The  decision  maker  types  CAPITAL  COSTS, 
OPERATING  t'OSTS , and  FUEL  COSTS  and  uses  the  calculator  to  define 
"electric  cost/kwh"  as  the  sum  of  these  quantities.  The  video 
screen  now  appears  as  In  Figure  3.5. 

At  this  point  It  occurs  to  our  decision  maker  that  he  may  not 
have  defined  his  system  broadly  enough.  S5nce  sulfur  oxides  and 
other  pollutant  emissions  from  power  plants  are  a by-product  of 
electricity  generation,  one  alternative  for  reducing  these  emissions 


Is  to  reduce  the  electric  output  (the  load  factor)  for  the  plant. 
Therefore,  the  number  of  kilowatt  hours  generated  by  the  plant  may 
he  a variable.  "Th'J  ultimate  determinant  of  the  success  of  a given 
strategy  will  be  the  total  annual  costs  Imposed  on  society,"  thinks 
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FIGURE  3.4  STEP  TWO  FOR  MODELING  THE  SULFUR  EMISSION  PROBLEM 


FIG'JHE  3.5  STEP  THREE  FOR  MODELING  THE  SULFUR  POLLUTION  PROBLEM 


r. 


our  decision  maker,  and  he  types 


TOTAL  ANNUAL  SOCIETAL  COST  [3  ANNUAL  KWH  GENERATED  X 

t 

CAIMbS  labels  this  equation  as  the  definition  of  operator  number  4, 
recognizes  that  two  new  entitles  have  been  defined,  and  locates  the 
proper  place  In  the  branching  structure  to  add  the  additional  enti- 
tles, operator  and  connecting  lines.  An  Instant  later  the  branching 
structure  appears  as  shown  In  Figure  3.6. 

r* 

Our  decision  maker  may  continue  to  use  the  branching  technique 
until  he  has  defined  all  entitles  In  terms  of  terminal,  elemental 
quantities  that  he  feels  comfortable  estimating.  Operator  deflnl- 

n 

tlons  need  not  be  confined  to  simple  arithmetic  functions  like  ad- 
dition and  multiplication.  If  necessary  more  general  functlonL-  )r 
subroutines  may  be  used  to  define  the  relationships  among  system 
entitles.  For  example.  In  the  actual  branching  structure  which  was 
used  for  the  sulfur  emissions  problem  (partially  Illustrated  in 
Figure  3.1),  the  operator  relating  the  entity  block  "Increase  in 

t 

SO4  concentration"  to  the  entitles  below  It  was  defined  by  a dif- 
ferential equation. 

Repreaentaticn  of  the  Deteiminietio  Valus  Model 

For  the  purposes  of  our  example,  let  us  suppose  that  our  deci- 
sion maker  continues  expanding  the  system  by  branching  from  enti- 
ties until  the  structure  appears  as  shown  in  Figure  3.7.  At  this 

r. 

point  our  decision  maker  feels  that  with  a little  research  he  can 


"total ^ 

SOCIETAL 

COST/KWH 

y 


r 
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FIGURE  3.6  STEP  FOUR  FOR  MODELING  THE  SULFUR  POLLUTION  PROBLEM 


FIGURE  3.7  STEP  TEN  FOR  MODELING  THE  SULFUR  POLLUTION  PROBLEM 


come  up  with  estimates  of  values  for  the  elemental  state  variable 
entitles,  and  he  sees  that  the  Important  decision  alternatives 
"type  coal  consumed,"  "coal  washing  technology,"  and  "FGD  (flue 
gas  desulfurization)  technology"  have  all  been  represented. 

The  branching  structure  shown  in  Figure  3.7  (and  for  that 
matter  each  structure  that  appeared  in  the  development  of  Figure 
3.7)  when  combined  with  analytic  operator  definitions  completely 
specifies  the  deterministic  structure  necessary  for  evaluating 
various  decision  strateglec.  Given  specific  alternatives  for  the 
decision  variables  and  given  specific  values  for  the  elemental 
state  variables,  evaluation  of  the  branching  structure  will  pro- 
duce a value  for  total  annual  societal  cost.  The  branching  struc- 
ture, therefore,  represents  a mathematical  model  for  the  sulfur 
emission  problem.  An  important  question  is,  "How  good  is  this 
model?"  CADMUS  supplies  a number  of  tests  for  model  evaluation. 
Ppoblem  Analusis 

One  Important  capability  possessed  by  CADMUS  is  the  ability 
to  perform  sensitivity  analyses.  In  sensitivity  analysis,  the 
decision  analyst  tries  to  determine  the  change  in  the  model's 
selection  of  alternative  actions  or  outcome  values  that  would  re- 
sult from  a given  change  in  the  model's  assumptions.  Assumptions 
that  produce  small  changes  are  apparently  relatively  insignifi- 
cant, while  assumptions  that  produce  considerable  changes  are 
likely  quite  significant.  CADMUS  provides  for  a number  of  automa- 
tic sensitivity  calculations.  For  example,  suppose  our  decision 
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maker  felt  uneasy  about  his  estimates  of  the  various  pollution 
costs  per  poind  of  sulfur  emitted.  He  night  feel  that  these 
costs  could  add  up  to  anything  between  zero  and  as  much  as  eighty 
cents  per  pound  of  sulfur  emitted.  Knowing  how  much  this  uncer- 
tainty is  reflected  as  uncertainty  in,  for  example,  total  societal 
cost/kwh  win  be  important  information  in  determining  whether  fur- 
ther effort  should  be  expended  in  clarifying  the  estimation  of 
pollution  costs. 

Suppose,  therefore,  that  our  decision  maker  elects  to  calcu- 
late the  way  the  value  of  total  societal  cost/kwh  behaves  as 
pollution  cost/lb  of  sulfur  emitted  is  varied.  He  begins  by 
choosing  specific  alternatives  for  the  decision  variables: 


>PE  COAL  consumed)  (~^  (higH  SUT  ^TO  rnAr 


COAL  WASHING  TECHNOLOGY^ 


Control  buttons  for  the  various  alternatives  will  have  been  defined 
when  the  operators  7,  8,  9,  10,  and  11  in  Figure  3.7  ace  defined. 
(This  process  will  be  lllustra.ed  in  the  following  section  where 
wfc  apply  the  branching  structure  technique  to  a discrete  event 
problem.)  Next  nominal  values  are  assigned  to  e'emental  state 
variables : 


r 
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(plant  efficiency^  pr]  f33~)  ^ 

(capital  costs ~)nn  s (m 
(opekatinc  costs') □JT]  MILlS/m 
CpUEL  COS^ [ - I fioTlI  MILLS/KWH.*’** 


SENSITIVITY 


control  button. 


By  touching  his  light  pen  to  the 
the  decision  maker  signals  CADKUS  that  he  wishes  to  perform  a 

and  then 


sensitivity  calculation.  Pushing  DEPENDENT  VARIABLE 
(JOTAL  SOCIe'^^  COST/KWh)  ..taUl.hM  th.  d.p.ndent  v.rlrtl.  1„ 
the  relationship.  Our  decision  maker  wishes  to  learn  how  the 


value  of  this  variable  varies  as  he  varies  pollution  cost/lb  sulfur 
emitted  between  the  values  of  zero  and  80c.  In  order  to  communicate 
this  to  CADMUS  he  uses  his  light  pen  to  push  the  respective  buttons 
[independent  variable  I and  (mLUTION  COST/LB  SULFUR  EMITTED^ 
and  then  [f^  ^ . The  video  screen  momentarily 

goes  blank  and  then  appears  as  Figure  3.8,  showing  the  functional 


*To  simplify  notation,  numbers  which  require  a sequence  of  button 

represented  as  if  they  could  be  soe- 
clfled  by  a single  button.  For  example,  the  notation  riO 
.eans  that  the  buttons  aJe'  pu^^h^d^n  ^sion. 

functions  of  the  decision  variables 
ndeed,  such  functional  connections  were  made  in  the  branchine 
structure  that  was  actually  used  in  the  analysis  for  this  problem 

p!iiy"hTdi':::sJ:r  ' 
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n. 


relationship  established  between  the  variables  "total  societal 
co3t/kwh"  and  "pollution  cost/lb  sulfur  emitted."*  Since  "total 
societal  cost/kwh"  Is  the  sum  of  "electric  cost/kwh"  and  the  pro- 
duct of  "lbs  sulfur  emltted/kwh"  and  "pollution  cost/lb  sulfur 
Knitted,  the  relationship  Is  Indeed  linear  as  shown. 

Our  decision  maker  may  also  wish  to  see  similar  sensitivity 
plots  for  ocher  decision  strategies.  For  example,  If  he  were  to 
set  "type  coal  consumed"  to  "low  sulfur  eastern  coal"  ind  re-ran 
the  sensitivity,  the  result  would  appear  something  like  that  shown 
In  Figure  3.9.  Similarly,  If  he  reset  "type  coal  consumtd"  to 
"high  sulfur  coal"  and  set  "FGD  technology''  to  "FoD,"  the  result 
of  the  sensitivity  run  would  appear  something  like  toat  shown  Ir 
Figure  3.10.  An  Instructive  exercise  would  be  fo  display  simul- 
taneously the  various  sensitivity  plots  for  the  various  decision 
alternatives.  By  storing  the  results  and  then  pushing  RECALL 
our  decision  maker  could  generate  the  plot  shown  In  Figure  3.11. 
Such  a plot  Illustrates  the  closed  loop  sensitivity  of  "total 
societal  cost/kwh"  to  "pollution  cost/lb  sulfur  &jltted."  The 
closed  loop  sensitivity  shows  how  the  optimal  value  of  the  depen- 
dent variable  changes  with  different  values  for  the  Independent 
variable.  Since  the  objective  Is  to  choose  the  decision  strategy 
so  as  to  mlnlml;:e  ’’total  societal  cost/kwh,"  this  sensitivity  Is 
given  by  the  piecewise  linear  curve  fonu'^d  by  the  lower  envelope 
of  the  three  straight  line  curves. 


The  numerical  values  shown  In  Figure  3.8  and  those  that  follow  are 
meant  to  be  Illustrative  only. 
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CONTRACT 


FIGURE  3.10  SENSITIVITY  OF  TOTAL  SOCIETAL  COST/kWh  TO  POLLUTION  COST/LB  SULFUR  EMITTED 
(flue  gas  desulfurization) 


CONTRACT 


1 


FIGURE  3.11  SENSITIVITY  OF  TOTAL  SOCIETAL  COST/k'.Vh  TO  POLLUTION  COST/LB  SULFUR  EMITTED 


CADMUS  may  be  requested  to  perform  a number  of  addltloii^l  calcu- 
lations which  will  enable  the  decision  maker  to  evaluate  his  al- 
ternative decision  strategies.  For  example,  he  may  ask  to  check 
for  dominated  courses  of  action;  that  Is,  decision  strategies  which 
for  all  possible  state  outcomes  yield  values  equaled  or  exceeded 
by  other  alternative  strategies.  The  decision  maker  may  request 
to  see  the  "profit  lottery"  associated  with  a given  course  of 
action.  CADMUS  will  then  supply  the  cumulative  probability  dis- 
tribution which  will  give  the  probability  that  the  outcome  as- 
sociated with  that  decision  strategy  will  have  a value  less  than 
or  equal  to  any  given  amount. 

To  Illustrate  the  latter  possibility  suppose  that  our  deci- 
sion maker  were  to  specify  a probability  distribution  tor  health 
cost/lb  of  sulfur  emitted  such  as  that  shown  In  Figure  3.12.  A 
number  of  methods  to  aid  the  decision  maker  In  assessing  such  a 
distribution  are  provided  by  CADMUS.  By  touching  his  light  pen 
("probability  distribution"  control  button)  and 


to 


PROB  DIST 


then  to  ^TOTAL  ANNUAL  SOCIETAL  COSt)  , the  decision  maker  would 
Instruct  CADMUS  to  produce  cumulative  probability  distributions 
for  "total  annual  societal  cost"  under  the  various  decision  alter- 
natives (Figure  3.13).  The  curve  associated  with  a given  decision 
strategy  would  show,  for  that  strategy,  the  probability  that  total 
annual  societal  cost  lay  below  any  given  amount. 
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FIGURE  3.12  PROBABILITY  DISTRIBUTION  ILLUSTRATING  UNCERTAINTY  IN  HEALTH  COSTS  PER  POUND  OF  SULFUR  EMISSIONS 


COAL  BURNING  ELECTRIC  POWER  PLANT 


3*2.3  Conclusions  Concerning  the  Applicability  of  the  Branching 
Structure  Approach  to  Single  Stage  Decision  Models. 

In  our  preceding  exercise  the  postulated  computerized  system  for  de- 
cision analysis  was  employed  primarily  to  illustrate  the  usefulness  of  the 
branching  structure  language  of  entitles  and  operators  for  representing 
single  stage  deterministic  models.  The  branching  structure  language  pro- 
vides a convenient  method  to  record  a well-specified  deterministic  value 
model.  The  le  guage  Is  also  a tool  to  aid  In  model  construction.  Using 
the  crystal  ball"  algorithm  a user  can  develop  a model  right  at  the  com- 
puter terminal. 

3*3  APPLICATION  OF  THE  GRAPHICAL  LANGUAGE  FOR  MODEL  DEVELOPMENT  TO  A 
SEQUENTIAL  PROBABILISTIC  DECISION  PROBLEM  WITH  A DISCRETE  EVENT 
STRUCTURE. 


The  concept  of  using  a branching  structure  as  a modeling  language 
was  originally  developed  to  apply  to  deterministic,  single  stage  con- 
tinuous variable  models.  At  the  end  of  the  previous  section  we  showed 
that  relaxation  of  the  deterministic  restr:'.ctlon  Is  not  difficult.  Basic- 
ally, by  holding  the  decision  variables  at  a specific  setting  and  specify- 
ing probability  distributions  on  the  state  variables  it  is  straight- 
forward to  generate  a "profit  lottery,"  a probability  distribution  on 
the  output.  Surprisingly,  It  Is  also  possible  to  relax  the  other  two  con- 
straint j and  consider  sequential  decisions  and  discrete  variables  within 
the  same  general  branching  structure. 

To  illustrate,  we  shall  use  a sample  problem  called  the  Used  Car  Buyer, 
Howard  [4a] . The  Used  Car  Buyer,  a decision  problem  of 
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moderate  difficulty,  is  used  at  Stanford  University  to  teach  deci- 
sion analysis  to  graduate  students. 


Our  decision  maker,  named  Joe,  is  interested  In  purchasing 
a used  car.  He  has  found  a car  he  likes,  but  because  of  uncer- 
tainties involving  possible  repair  coats,  he  is  unsure  about 
whether  he  should  buy  or  refuse  the  deal  offered  by  the  salesman. 

The  car  might  be  a "peach"  or  it  might  be  a "lemon".  If  It  is 
a peach  it  will  have  a defect  that  will  require  Joe  to  repair 
exactly  one  of  the  car's  ten  major  systems.  If  it  is  a lemon  Joe 
will  soon  have  to  repair  exactly  six  of  the  car's  major  systems. 

The  salesman  offers  to  let  Joe  take  the  car  to  his  mechanic  to 
check  out  the  condition  of  one  or  more  of  the  car's  ten  systems. 

In  addition,  he  offers  Joe  the  possibility  of  purchasing  a guarantee 
plan  (an  "anti-lemon  feature'),  which  will  help  pay  for  any  repair 
costa  that  might  arise  after  purchase. 

Suppose  that  Joe  decides  to  seek  help  for  his  problem  from 
CADMUS.  He  slts  down  before  his  terminal,  throws  a switch,  and 
asks  CADMUS  for  help  in  model  formulation.  CADMUS  asks: 

WHAT  QUANTITY  OR  QUANTITIES  WOULD  YOU  NEED  TO  KNOW  TO 
EVALUATE  THE  OUTCOME  OF  YOUR  DECISION? 

Accustomed  to  thinking  in  monetary  terms,  Joe  types  NET  PROFIT  into 
the  computer.  CADMUS  responds  with: 

SUPPOSE  YOU  HAD  A CRYSTAL  BALL.  YOU  MAY  ASK  IT  ANY  NUMERICAL 
QUESTION  EXCEPT  "WHAT  IS  'NET  PROFIT'?"  FOR  WHAT  QUANTITY 
OR  QUANTITIES  WOULD  YOU  ASK  IN  ORDER  TO  CALCULATE  "NET  PROFIT"? 

1 
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Joe  enters  VALUE  and  then  COST.  Immediately  the  video  screen 
represents  these  entries  as  entities  in  a graphical  structure 
(Figure  3.14).  Joe  now  addresses  his  attention  to  the  calculator 
in  the  lower  right  hand  corner  of  the  screen.  Thinking  "net 

profit  equals  the  difference  between  revenue  and  costs",  Joe  uses 
his  light  pen  to  "punch"  in 

(^NET  PROFI*^  (*VALUE^nn  (^ST^ 

by  alternately  touching  the  appropriate  entitles  In  the  branching 
structure  and  operator  buttons  on  the  calculator.  As  he  proceeds, 
the  equation  defining  operator  number  one  appears  at  the  bottom 
of  the  video  screen. 

Joe  touches  the  light  pen  to  the  entity  block  marked  "cost" 
and  CADMUS  answers: 

SUPPOSE  YOU  HAD  A CRYSTAL  BALL.  YOU  MAY  ASK  ANY  NUMERICAL 

QUESTION  EXCEPT  ’WHAT  IS  ’COST’?"  FOR  WHAT  QUANTITY  OR 

quantities  would  you  ask  in  order  to  calculate  "COST"? 

"Well,"  thinks  Joe  as  he  types  on  the  terminal,  "my  costs 
will  consist  of  the  asking  PRICE,  a REPAIR  COST  if  the  car  breaks 
down,  a GUARANTEE  COST  if  I take  advantage  of  the  guarantee  plan, 
and  a TEST  COST  if  I ask  my  mechanic  to  look  over  the  car  before 
I buy  it."  The  branching  structure  on  the  video  screen  now  ap- 
pears as  in  Figure  3.13.  Using  the  calculator,  Joe  has  no  diffi- 
culty "pushing"  the  right  buttons  to  express  cost  as  the  sum  of 
price,  repair  cost,  guarantee  cost,  and  test  cost. 
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FIGURE  3.14  STEP  ONE  FOR  MODELING  THE  USED  CAR  BUYER  PROBLEM 


[ 


Redirecting  his  attention  to  the  branching  structure  of 
Figure  3.15,  Joe  touches  the  light  pen  to^TEST  COS*:^.  The  familiar 
question,  this  time  asking  him  what  he  would  need  to  know  to  de- 
fine "test  cost",  appears  on  the  screen.  "This  is  a little  more 
complicated,"  thinks  Joe  as  he  pulls  the  notes  he  made  of  a con- 
versation he  had  with  his  mechanic.  The  dealer  placed  a time 
limit  of  one  hour  on  the  car's  absence  from  the  lot.  In  this  short 
time  allotment  Joe's  mechanic  said  he  could  at  most  check  only 
two  of  the  car's  ten  major  systems.  In  particular  he  said  that 
he  would 

1.  test  the  steering  system  alone,  at  a cost  of  $9; 

2.  test  the  fuel  and  electrical  systems,  for  a total  cost  of  $13; 

3.  test  the  transmission,  at  a cost  of  $10,  report  the  out- 
come of  the  test  to  Joe,  and  then  proceed  to  check  the 
differential,  at  an  additional  cost  of  $4,  if  he  is  re- 
quested to  do  so. 

"Well,  the  test  cost  will  depend  upon  which  of  the  test  options 
I choose,"  thinks  Joe  as  he  types  in  TEST  TYPE.  Since  "test  type" 
is  a decision  variable,  he  immediately  adds,  DECISION.  "And 
also,"  he  continues,  "if  I choose  the  sequential  test  option,  it 
will  depend  upon  whether  I Instruct  my  mechanic  to  continue 
and  test  the  differential  as  well."  Joe  types  TEST  THREE  CONTINUE. 
Again,  since  this  is  a decision  variable,  Joe  types  DECISION.  N’xt, 

Joe  uses  the  logical  "IF"  and  "AND"  buttons  on  the  calculator  to 
write 


I 


1 

1 


I 


1 
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I 0 1 I if]  (^TEST  TYP£^(  ■ |(^no  test^ 

[T][if]  (test  type^CZ](test  1~) 

Li3  I I IF  I (test  type)  I " I (test  2") 

Lioj  [ip  J (^TEST  TYPE^l  " I (test  3^  (aND|  (tEST  THREE  CONTINUE)  [ - | [j 
[u]  ( if  1 (test  TYPE^Lj^  (test  3~)  (aNDI  (test  THREE  CONTINUE)  | - j [] 


Joe  h&s  def. 'ed  operator  number  3,  and  the  video  screen  now  appears 
as  in  Figure  3.16. 

Next  Joe  chooses  to  define  "repair  cost."  Acccvding  to  the 
nechanici  it  will  cost  about  $40  to  repair  a single  serious  defect 
in  one  of  the  car's  major  systems,  but  if  6 defects  were  to  be 
repaired,  the  price  for  all  6 would  be  only  $200.  The  anti- 
lemon guarantee,  Joe  recalls,  cost  $60  and  will  pay  for  50Z 
of  the  repair  costs  if  the  car  is  a peach,  lOOZ  of  the  costs  if  it 
turns  out  to  be  a lemon.  Joe  points  the  light  pen  to  (^PAIR  cci^ 
and  then  types  in  PEACH/LEMON,  GUARANTEE,  and  BUY/REFUSE,  indicating 
that  repair  costs  depend  upon  whether  or  not  the  car  is  a peach  or 
a lemon,  whether  he  purchases  the  guarantee,  and,  of  course,  whether 
or  not  he  buys  the  car.  Since  the  entities  "buy /ref use"  and  "guar- 
antee" are  decision  variables,  after  each  of  these  he  types  DECISION. 
With  the  calculator  for  defining  the  operator,  he  writes 


[TJIIp]  (buy/refuss)  rn  (refuse^ 

[IlI  ( BUY/REFUSE^r^(ig)  ( GUARANTEE  ^[71  (n^ 

f^ND|  ( PEACH/LEMON^r~7  (l^ON^ 

Ho]  [ZlI  Quy/refuse)  GJ  ra  (guarantee^  1T1(no^ 
[andI  ^peach/lem^ r^n(mcir) 
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FIGURE  3.’6  STEP  THREE  FOR  MODELING  THE  USED  CAR  BUYER  PROBLEM 


A-f\ 


Qf]  (buy/refuse^  ra  riuT)  M 

S (%EACH/LEMON^  C L^ON^ 


[ID  (buy/refuse) 

(and|  ( peach/lemon)  mciQ 


guarantee 


guarantee^ 


The  branching  structure  now  appears  as  In  Figure  3.17. 

Joe  can  see  at  this  point  that  all  of  the  Important  system 
entitles  appear  on  his  video  screen.  All  that  remlans  now  Is 
for  him  to  upeclfy  the  remaining  connections.  "Well,"  he  thinks, 
"'value'  depends  upon  whether  or  not  I buy  the  car."  Joe  takes 
the  light  pen,  pushes  ( VALUE^  and  then  (bUY/REFUSe)  . 

Operator  dot  number  five  appears  on  the  streen  and  arrows 
appear  connecting  the  "buy/refuse"  block,  the  new  operator  dot, 
and  the  "value"  block.  Joe  estimates  the  value  of  the  car  to  be 
$1100,  so  he  specifies  operator  5 with 


.VALUE 


Ifiioo  1 

fiFl  (buy/refuse) 

IZI 

m 

[tfI  (buy/refuse)  I 

^BUYJ 

^REFUSE 


"The  asking  price  for  the  car  Is  "1,000,"  Joe  continues,  "so 
It  will  cost  me  $1,000  If  I decide  to  buy  the  car."  He  touches 
the  light  pen  first  to  (price)  and  then  to  (buY/REFUSe)  . Oper- 
ator 6 appears  and  Joe  types 


(^price  jnnriooo  i riFi  (buy/refuse^  rn(Bu?) 

E [ID  (buy /refuse)  n~|  (^fuse") 

Finally,  Joe  specifies  the  dependence  of  "guarantee  cost"  on  the 
"guarantee"  decision  by  touching  the  light  pen  to  the  two  blocks 


and  tlen  defining 


I 60 1 1 if|(  guarantee^ nn(Yi^  . 


The  branching  structure  appears  as  shown  In  Figure  3.18. 

3.3.1  Deterministic  Analysis 

Joe  looks  closely  at  the  branching  structure  that  now  shows 
on  the  video  screen  (Figure  3.18).  •'That  seems  like  all  the  con- 
nections," he  thinks,  "but  I'd  better  go  over  them  to  make  sure." 
Gradually  moving  hla  gaze  from  the  top  to  the  bottom  of  the  figure 
he  observes,  "Net  profit  will  equal  the  value  of  the  decision 
strategy  minus  the  costs.  Value  depends  upon  whether  or  not  I buy 

the  car.  Coat  equals  the  sum  of  price,  repair  cost,  guarantee 
cost,  and  teat  cost.  The  price  I pay  depends  on  whether  or  not  I 
buy  the  car.  Repair  cost  depends  on  whether  the  car  Is  a peach 
or  a lemon,  whether  or  not  I buy  the  car,  and  whether  or  not  I 

guarantee  the  car.  Guarantee  cost  depends  on  whether  or  not  I buy 

the  guarantee,  and  test  cost  depends  on  the  testing  strategy  I 
choose.  Yes,  It  seems  to  make  sense,"  he  thinks.  "If  I specify 
those  five  bottom-most  blocks,  that  should  specify  net  profit." 

However,  Joe  does  not  feel  entirely  convinced  of  his  last 
statement  and  decides  to  specify  a decision  strategy  and  an  out- 
come for  the  "peach/lemon"  state  variable  just  to  see  If  his  model 
yields  a reasonable  value  for  net  profit.  Joe  communlcf.ces  his 
Intent  to  CAIMJS  by  touching  the  control  button  marked  "data". 

The  branching  structure  of  Figure  3.18  vanishes  from  the  video 
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FIGURE  3.18  COMPLETE  VALUE  STRUCTURE  FOR  THE  USED  CAR  BUYER  PROBLEM 


screen  end  in  its  place  appears  the  calculator  of  Figure  3.19. 

For  each  elemental  variable  ( a block  in  Figure  3.18  having  no 
entering  arrows)  a corresponding  button  exists  on  the  face  of 
the  calculator.  The  buttons  are  categorized  according  to  whether 
they  represent  state  variables  or  decision  variables.  To  the  right 
of  each  state  variable  button,  there  is  a set  of  buttons  repre- 
senting the  possible  outcomes  that  have  been  so  far  defined  for 
that  variable.  Similarly,  to  the  right  of  each  decision  variable 
button  there  is  a set  of  buttons  representing  possible  alterna- 
tives for  that  decision  variable.  Joe  touches  the  light  pen  to 
the  buttons  as  he  would  on  a conventional  calculator  so  as  to 
write  the  following  equations: 


(PEACH/LEMON^rn  (lEMON^ 

(buy/refuse’)  (buT) 

(cUARANTEE")rri 

(test  TYPE")nn(^  test^ 
(test  three  continue^  I ■ |(n^ 


He  then  touches 


calculate 


Instant  later  shows  the  message 


The  screen  goes  blank  and  an 


NET  PROFIT  - -100. 

Jo.  v,rlfl.,  thl.  r.8Ult.  "If  I .cc.pt  th.  h. 

r...on.,  "I  will  p.y  n.OOO  for  . c.c  I boll.,,  to  b.  «,rth  Sl.lOO 
Ho..v.r,  If  th.  c.r  turn,  out  to  b.  a l«,on.  I'll  h.*.  to  p.y  $200 
In  r.p.lr  bill,.  Th.r.for.,  I wjuld  .nd  up  loalng  $100  doll.r.  In 
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DECISION  VARIABLES  ALTERNATIVES  STATE  VARIABLES  OUTCOMES 


FIGURE  3.19  CONTROL  PANEL  FOR  DETER.VIINISTIC  ANALYSIS 


the  deal."  Feeling  encouraged,  Joe  decides  to  check  his  model 
with  a few  more  calculations.  Typing  ANALYSIS,  the  calculator 
of  Figure  3.19  again  appears.  Joe  touches  the  buttons  so  as  to 
write 


(peach/lemon)  □]  r peach  Xn (lemon) 
(BUY/REFUSE)nn  (buT) 

(guarantee^!  - 1(ye?) 

^Test  typT)!  I (test  2^ 

(test  three  continue) I - I(n^ 


Joe  pushes 


CALCULATE 


and  the  result  appears  on  the  screen. 


NET  PROFIT  - 7,  27 


Joe  Is  somewhat  surprised  to  see  that  his  model  Indicates  that 
he  will  make  more  money,  $27,  If  the  car  turns  out  to  be  a lemon, 
than  the  $7  he  will  make  If  .'t  turns  out  to  be  a peach.  He 
verifies  the  result  as  follows:  "If  I buy  the  car,  I make  $100 

since  the  price  Is  that  much  below  what  I believe  to  be  the  value 
of  that  make,  model,  and  year.  Testing  decision  number  two  will 
cost  me  $13  and  the  guarantee  costs  $60.  If  the  car  Is  a peach, 
the  guarantee  will  pay  for  50%  of  the  $40  repair  costs.  That 
meant  my  net  profit  would  be  $100  - $13  - $60  - $20  - $7.  If  the 
car  Is  a lemon,  the  guarantee  will  pay  for  all  repair  costs  so  the 
net  profit  will  be  $100  - $13  ~ $60  “ $27.  That  checks,"  thinks  Joe. 
3.3.2  Influence  Specification 

The  branching  structure  of  Figure  3.18  lacks  an  Important 
specification  of  a decision  problem,  probabilistic  dependencies 
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representing  the  effects  of  Information.  Such  dependencies  may 
be  of  crucial  Importance  for  decision  making  and  cannot  be  Ignored, 
In  the  Used  Car  Buyer  Problem,  for  example,  the  outcome  of  the  teet 
that  might  be  performed  by  the  mechanic  is  not  included  as  an 
entity  in  the  model  of  Figure  3.18  because  that  outcome  does 
not  have  any  direct  effect  on  net  profit.  On  the  other  hand, 
the  outcome  of  such  a teat  will  Influence  Joe's  estlmitlon  of 
the  likelihood  that  the  car  Is  a peach.  Since  Joe’s  purchasing 
decision  will  be  strongly  dependent  on  his  perception  of  the  odds 
that  the  car  la  a peach,  the  outcome  of  the  test  Is  Important 
Information. 

Specif uing  Information  Flow  With  CADMUS 

One  method  for  describing  Informational  flow  with  CADMUS  Is 
to  Incorporate  an  Influence  diagram  (see  Section  2.4.2)  Into  the 
deterministic  branching  structure  representing  the  problem's 
value  model.  Let  us  suppose  that  our  used  car  buyer,  Joe,  chooses 
to  use  this  technique.  Joe  Informs  CADMUS  by  typing  INFLUENCE 
DIAGRAM  on  the  terminal.  CAWIU3  answers: 

IF  YOU  WISH  YOUR  DECISION  STRATEGY  TO  BE  CONDITIONED  UPON 
INFORMATION  OR  STATE  VARIABLE  OUTCOMES  WHICH  MIGHT  BEC(»ffi 
KNOWN  DURING  THE  DECISION  PROCESS,  LIST  ALL  SUCH  INFORMATION 
OR  OUTCOME  VARIABLES  WHICH  HAVE  NOT  YET  BEEN  INCLUDED  IN 
THE  BRANCHING  STRUCTURE. 

The  Information  generated  In  the  course  of  Joe's  decision 
process  will  be  the  outcomes  of  any  tests  that  he  asks  his  mechanic 
to  perform.  Therefore,  Joe  types 
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TEST  OUTCOIE 


However,  If  Joe  chooses  "test  3",  the  sequential  testing  strategy, 
Joe  has  the  option  to  ask  that  a second  system  In  the  car  be  tested 
after  he  learns  the  result  of  the  first  test.  Hence,  the  outcome 
of  the  decision  to  continue  testing  Is  a possible  piece  of  Infor- 
mation upon  whlcn  Joe  will  wish  to  base  his  purchase  and  guarantee 
decisions.  Joe  types 

CONTINUE  TEST  OUTCOME 

and  signals  CADMUS  that  this  Is  the  last  Information  variable  to 
be  added  to  the  model.  The  branching  structure  appears  on  the 
screen  togehter  with  entity  blocks  representing  the  added  Infor- 
mation variables  (Figure  3.20). 

Joe  must  now  Interconnect  the  added  Information  variables 
and  the  elemental  state  and  decision  variables  In  the  form  of  an 
Influence  diagram.  In  masy  problems  this  connection  Is  facilitated 
by  thinking  first  of  the  order  In  which  the  decisions  must  be  made 
and  the  state  variable  outcomes  become  known.  Joe  must  first  de- 
cide on  the  "test  type."  Then  the  "test  outcome"  becomes  known, 
and  Joe  may  have  the  option  to  ask  that  another  test  be  performed 
("test  three  continue").  If  he  has  chosen  this  option  the  "con- 
tinue test  outcome"  Is  revealed  and  Joe  must  decide  to  buy  or 
refuse  the  car  deal  ("buy/refuse"),  and.  If  he  buys  the  car, 
whether  or  not  to  have  It  guaranteed  ("guar  uitee") . Only  after  he 
makes  these  decisions  does  he  finally  learn  for  sure  whether  the 
car  Is  a peach  or  a lemon  ("peach/lemon") . 
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TION  OUTCOMES 


The  probability  of  the  car  being  a peach  or  a I'imon  may  de- 
pend on  the  teat  outcomes.  Joe  must  represent  this  probabilistic 
dependence  by  drawing  Influence  arrows  from  the  "continue  test 
outcome"  block  and  from  the  "test  outcome"  block  to  the  "peach/ 
lemon"  block.  Influence  arrows  may  be  drawn  using  CADMUS  by 
touching  the  light  pen  first  to  the  entity  block  from  which  the 
arrow  Is  to  originate  and  then  to  the  block  at  which  It  Is  to 
terminate.  An  arrow  connecting  the  two  blocks  will  Immadlately 
materialize  on  the  video  screen. 

The  "buy/refuse"  decision  as  well  as  the  "guarantee"  de- 
cision ought  to  depend  upon  the  testing  outcomes  so  Influence 
arrows  are  drawn  from  each  of  the  test  outcome  blocks  to  the 
"buy/refuae"  and  "guarantee"  decision  blocks.  A "continue  test 
outcome"  can  only  exist  If  the  decision  Is  made  to  continue  test- 
ing, so  an  influence  arrow  must  be  drawn  from  the  "test  three 
continue"  block  to  the  "continue  test  outcome"  block.  An  arrow 
Is  drawn  also  from  the  "teat  outcome"  block  to  the  "continue  test 
Outcome"  block  because  the  assessment  of  the  probabilities  of  the 
various  outcomes  for  the  second  test  will  most  likely  be  Influenced 
by  the  outcome  of  the  first  test.  Since  the  "test  three  continue" 
decision  may  only  be  made  If  the  third  test  type  Is  chosen,  and 
since  this  decision  may  be  made  with  knowledge  of  the  first  "test 
outcome",  arrows  are  drawn  connecting  the  test  type  and  teat  out- 
come blocks  to  the  test  three  continue  block.  The  complete 
branching  structure  for  the  Used  Car  Buyer  Problem,  Including  the 
appended  Influence  diagram.  Is  now  on  the  video  screen.  This  Is 
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Illustrated  in  Figure  3.21, 
3.3.3  Constraint  Statements 


One  thing,  however,  both-trs  Joe.  He  has  not  made  It  clear 
yet  that  some  state  variable  outcomes  and  some  decision  ..Iterna— 
tlves  In  his  problem  exist  only  under  certain  conditions.  For 
example,  the  "test  three  continue"  decision  cannot  be  made  unless 
the  testing  strategy  is  chosen  to  be  "test  3".  To  make  such  prob- 
lem constraints  specific,  Joe  types  "constraints"  and  the  calculator 
of  Figure  3.22  appears  on  the  screen.  Joe  pushes  the  calculator 
buttons  so  as  to  write 

[no]  (test  three  continue^  fTFI  ( test  TYPE^  [notI  rn(TEST  3^ 

1 NOj  (C0NTI!«JE  TEST  OUTCOME)  flFl  (tEST  THREE  CONTINUE)  | - ] 

[n^  (test  CUTCoiffi)  fTFI  (test  TYPE*)nn(NO  TEST^ 

[noI  ( GUARANTEE ^[TfI  (bUY /REFUSE^ (rEFUSe) 

3. 3. A Probability  Specification 

To  calculate  the  optimal  decision  strategy  under  uncertainty, 
probability  assignments  must  be  expressed  In  a form  which  is  appro- 
priate to  the  given  problem  structure.  Frequently,  this  will  not 
be  the  form  that  the  decision  maker  finds  most  convenient  for  as- 
sessing t'^obabllltles.  Consequently,  calculations  are  usually  re- 
quired to  convert  from  one  form  to  another.  This  conversion  Is 
accomplished  using  Bayes’  rule. 

CADMUS  will  perform  Bayes'  rule  automatically  so  the  decision 
maker  may  specify  probabilities  under  any  conditioning  assumptions 
he  desires.  A number  of  methods  to  aid  the  decision  maker  In 
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assessing  probabilities  for  the  uncertain  state  variables  are 
provided  by  CAMIUS. 

For  the  Used  Car  Buyer  Problem,  probability  assessment  is 
most  natural  in  the  order  represented  in  Figure  3.23.  Joe  believes 
that  there  is  a one  in  five  chance  that  the  used  car  he  is  interested 
in  is  a lemon.  So,  the  a priori  probability  of  the  car  being  a 
lemon  is  0.2,  and  the  a priori  probability  of  it  being  a peach  is 
0.8.  Joe  must  now  determine  the  probabilities  of  the  various  pos- 
olblii  test  outcomes  given  that  the  car  is  a lemon  or  given  that 

it  is  a peach.  This  la  a simple  problem  in  combinatorial  mathe- 
matics. 

In  a lemon  exactly  six  of  the  car's  ten  systems  will  be  de- 
fective. Suppose  that  one  major  system  of  the  car  is  tested.  Since 
the  car  is  a lemon,  there  is  probability  6 in  10,  or  0.6,  that  the 
system  being  tested  happens  to  be  one  of  the  defective  systems. 
Therefore,  if  the  car  is  a lemon  and  the  "test  type"  is  "test  1", 
then  there  is  probability  0,6  that  the  test  outcome  will  be  "defect" 

and  a probability  0.4  that  this  outcome  will  be  "no  defect" 

/ 

Suppose  that  a defective  system  is  found  on  the  first  test. 

There  are  nine  remaining  untested  systems  in  the  car,  and,  out  of 
those  nine,  five  are  defective.  Therefore,  if  a second  system  is 
tested  there  is  probability  5 in  9,  or  5/9,  that  this  system  will 
likewise  be  defective.  Hence,  the  probability  of  finding  two  de- 
fective systems  in  two  tests  is  0.6  x 5/9  - 1/3.  Stated  differently, 
if  the  oar  is  a lemon,  and  if  the  "test  type"  is  "test  2",  then 
there  is  probability  1/3  that  the  teat  outcome  is  "two  defects". 
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FIGURE  3.23  NATURAL  CONDITIONING  ORDER  FOR  PROBABILITY  SPECIFICATIONS 
FOR  THE  USED  CAR  BUYER  PROBLEM 


C 


By  continuing  with  such  reasoning,  Joe  is  able  to  determine  all 
the  probabilities  necessary  for  the  specification  of  the  informa- 
tional model  Illustrated  in  Figure  3.23. 

Joe  must  now  input  these  probabilities  to  CADMUS,  By 
typing  PROBABILITY  SPECIFICATION  on  the  terminal  a probability 
specification  "calculator"  is  made  to  appear  on  the  screen  (Figure  3.24). 
This  calculator  will  minimize  the  work  needed  to  input  state  var- 
iable probilities.  Additional  "buttons"  may  be  defined  as  needed 
on  the  calculator  to  correspond  to  state  variable  outcomes  which 
have  not  yet.  been  defined.  The  decision  maker  merely  couches  the 
light  pen  to  the  screen  and  then  types  in  the  outcome  name  on  the 
terminal  keyboard.  In  this  way  Joe  obtains  buttons  on  his  calcu- 
lator for  the  various  possible  testing  outcomes. 

The  logical  and  mathematical  expressions  that  Joe  enters  with 
the  calculator  are  shown  in  Figure  3.25.  Joe  may  ask  CADMUS  to 
Illustrate  his  probability  specifications  in  a probability  tree. 

If  he  does  so  the  video  screen  would  appear  as  shown  in  Figure  3.26. 

3.3.5  Representation  of  the  Decision  in  a Decision  Tree 

To  check  his  model  Joe  may  ask  to  see  it  Illustrated  in  de- 
cision tree  form.  If  at  this  point  Joe  were  to  type  DECISION  TREE, 
the  tree  structure  of  Figure  3.27  would  appear  on  the  video  screen. 
(Ignore  for  the  moment  the  arrows  shown  on  some  decision  branches 
and  the  figures  within  the  circles.)  The  reader  may  verify  that 
Joe  has  completely  specified  his  model.  Joe's  first  decision  is 
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FIGURE  3.24  CALCULATOR  FOR  SPECIFYING  PROBABILITIES 


IF  PEACHA.EMON  = PEACH 


IF  TEST  TYPE  = TEST  1 OR  TEST  3 


TEST  OUTCOME  = 


defect  . 1 

NO  DEFECT  , 9 


IF  TEST  TYPE  = TEST  2 


TEST  OUTCOME  = 


NO  DEFECT  4/5 

1 DEFECT  1/5 

2 DEFECT  0 


IF  TEST  TYPE  = TEST  3 


IF  TEST  OUTCOME  ■ DEFECT 


SECOND  TEST  OUTCOME  = 


DEFECT  0 
NO  DEFECT  1 


IF  TEST  OUTCOME  = NO  DEFECT 


SECOND  TEST  OUTCOME 


DEFECT  1/9 

NO  DEFECT  8/9 


Figure  3.25;  PROBABILITY  SPECIFICATION  FOR  THE 
USED  CAR  BUYER  PROBLEM 


!k 
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IF  PEACH/LEMON  = LEMON 

IF  TEST  TYPE  ■ TEST  1 OR  TEST  3 

TEST  OUTCOME  = 


DEFECT  , 6 

NO  DEFECT  . 4 


IF  TEST  TYPE  = TEST  2 


TEST  OUTCOME  = 


I NO  DEFECT 

2/15 

1 

DEFECT 

8/15 

2 

DEFECT 

1/3 

IF  TEST  TYPE  - TEST  3 

IF  TEST  OUTCOME  = DEFECT 


SECOND  TEST  OUTCOME  = 


DEFECT  5/9 
NO  DEFECT  4/9 


IF  TEST  OUTCOME  = NO  DEFECT 


SECOND  TEST  OUTCOME  = I 2/3 

NO  DEFECT  1/3 


Figure  3.25:  PROBABILITY  SPECIFICATION  FOR  THE 

USED  CAR  BUYER  PROBLEM 


(Concluded) 
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to  choose  whether  or  not  to  have  the  car  checked  and  if  so,  which 
of  the  three  testing  strategies  to  choose.  If,  for  example,  he 
chooses  "test  type"  "test  2",  two  of  the  car's  10  systems  will 
be  checked  and  Joe  will  learn  that  either  no  defects,  one  defect, 
or  two  c'efi  cts  were  found.  The  probabilities  of  these  various 
outcomes  have  been  calculated  by  CADMUS  using  Bayes*  rule  to  be 
0.67,  0.27,  and  0.07.  After  learning  which  outcome  actually  oc- 
curs, Joe  must  decide  to  buy  or  refuse  the  car  and  if  he  buys  it, 
whether  or  not  to  purchase  the  guarantee.  If  he  buys  the  car,  he 
will  finally  learn  whether  the  car  is  a peach  or  a lemon.  Joe  has 
now  completely  specified  his  model. 

The  complexity  of  the  decision  problem  is  made  apparent  ii 
the  decision  tree  structure  of  Figure  3.27.  Decision  makers  more 
experienced  with  decision  trees  would  have  the  option  of  inputting 
their  model  structure  directly  in  the  form  of  a decision  tree. 

This  could  be  accomplished  through  CADMUS  by  drawing  the  tree 
structure  with  the  light  pen  and  then  typing  the  parameters  asso- 
ciated with  the  tree's  nodes  and  branches  through  the  terminal. 

If  Joe  were  to  push  the  "optimize"  control  button,  CADMUS 
would  calculate  the  expected  value  associated  with  each  alternative 
for  each  decision  in  the  problem.  The  results  of  such  calculations 
are  shown  enclosed  within  circles  under  each  decision  branch  of 
of  the  tree  in  Figure  3.27.  At  this  point  CADMUS  is  able  to  iden- 
tify the  decision  strategy  that  maximizes  expected  net  profit. 
CAJMJS  isay  be  requested  to  read  out  this  strategy  as  a set  of 
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logical  "if-then"  type  statements  or  it  may  graphically  represent 
the  optimal  expected  value  strategy  by  placing  arrows  on  the  pre- 
ferred decision  alternatives  on  the  decision  tree  as  Illustrated 
In  Figure  3.27.  We  see  that  Joe  will  maximize  his  expected  net 
profit  if  he  Instructs  his  mechanic  to  perform  "test  2",  that 
is  test  fehe  fuel  and  electrical  systems,  and  then  buys  the  anti- 
lemon guarantee  only  If  a defect  If  found.  This  strategy  will 
produce  an  expected  net  profit  of  $32.87. 

3.3.6  Utility  Specification 

Tests  are  supplied  by  CADMUS  to  enable  the  decision  maker  to 
determine  whether  It  Is  necessary  to  express  his  risk  attitude  as 
a utility  function.  If  significant  risk  aversion  (or  tisk  prefer- 
ence) Is  Indicated,  CADMUS  will  supply  procedures  for  eliciting 
an  appropriate  utility  function. 

3. A CONCLUSIONS  AND  SUMMARY 

A branching  structure  has  been  described  which  allows  a 
decision  maker  to  express  compactly  the  structure  of  a decision 
problem.  Although  the  technique  was  originally  developed  to 
describe  single  stage  continuous  deterministic  models,  we  have 
seen  thpt  the  method  may  be  expanded  so  as  to  be  used  In  sequen- 
tial problems  with  discrete  events  and  significant  uncertainties. 
The  system  described  Is  an  Illustration  of  how  a computerized 
graphical  structure  may  help  a decision  maker  to  formulate  a deci- 
sion problem.  Current  research  has  demonstrated  the  feasibility 
of  such  a system  but  additional  research  will  be  required  to  de- 
termine exact  software  specifications. 
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